-- Logs begin at Mon 2022-08-29 19:26:57 UTC, end at Mon 2022-08-29 20:45:30 UTC. -- Aug 29 20:06:10.603813 dv-cinder-854262-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 20:06:10.616436 dv-cinder-854262-2-smb devstack@keystone.service[81642]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 20:06:10 2022] *** Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: nodename: dv-cinder-854262-2-smb Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: machine: x86_64 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: clock source: unix Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: pcre jit disabled Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: detected number of CPU cores: 4 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: current working directory: / Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: detected binary path: /usr/bin/uwsgi-core Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: your processes number limit is 47680 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: your memory page size is 4096 bytes Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: detected max file descriptor number: 2048 Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: lock engine: pthread robust mutexes Aug 29 20:06:10.617092 dv-cinder-854262-2-smb devstack@keystone.service[81642]: thunder lock: enabled Aug 29 20:06:10.617809 dv-cinder-854262-2-smb devstack@keystone.service[81642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 20:06:10.617809 dv-cinder-854262-2-smb devstack@keystone.service[81642]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 20:06:10.669488 dv-cinder-854262-2-smb devstack@keystone.service[81642]: Python main interpreter initialized at 0x55fcce8759c0 Aug 29 20:06:10.669488 dv-cinder-854262-2-smb devstack@keystone.service[81642]: python threads support enabled Aug 29 20:06:10.669488 dv-cinder-854262-2-smb devstack@keystone.service[81642]: your server socket listen backlog is limited to 100 connections Aug 29 20:06:10.669488 dv-cinder-854262-2-smb devstack@keystone.service[81642]: your mercy for graceful operations on workers is 90 seconds Aug 29 20:06:10.670153 dv-cinder-854262-2-smb devstack@keystone.service[81642]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 20:06:10.670153 dv-cinder-854262-2-smb devstack@keystone.service[81642]: *** Operational MODE: preforking *** Aug 29 20:06:10.670391 dv-cinder-854262-2-smb devstack@keystone.service[81642]: *** uWSGI is running in multiple interpreter mode *** Aug 29 20:06:10.670391 dv-cinder-854262-2-smb devstack@keystone.service[81642]: spawned uWSGI master process (pid: 81642) Aug 29 20:06:10.670530 dv-cinder-854262-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 20:06:10.673480 dv-cinder-854262-2-smb devstack@keystone.service[81642]: spawned uWSGI worker 1 (pid: 81650, cores: 1) Aug 29 20:06:10.673480 dv-cinder-854262-2-smb devstack@keystone.service[81642]: spawned uWSGI worker 2 (pid: 81651, cores: 1) Aug 29 20:06:10.673480 dv-cinder-854262-2-smb devstack@keystone.service[81642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 20:06:15.115452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:06:15.115452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: from cryptography.utils import int_from_bytes Aug 29 20:06:15.116621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:06:15.116621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: from cryptography.utils import int_from_bytes Aug 29 20:06:15.169572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:06:15.169785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:06:15.169922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] command line args: [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:06:15.170187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:06:15.170360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ================================================================================ {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:06:15.170606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] admin_token = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.170855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] config_dir = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.171041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.171220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] config_source = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.171396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] debug = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.171593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_config_append = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_dir = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_file = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.173855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.174075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.174319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.174564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.174739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.174912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.175151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.175393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.175626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.175857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.176087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.176316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.176598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.176844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.177118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.177623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.177803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] publish_errors = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.178039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.178263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.178439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.178682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.178920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.179152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] standard_threads = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.179371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.179609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.179782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.180029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] use_journal = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.180232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] use_json = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.180419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] use_stderr = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.180638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] use_syslog = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.180847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.181133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.181347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.181739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.182022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.182247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.182450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.182786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.183000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.183272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.183493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.183772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.183976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.184227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.184514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.184774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.185022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.185259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.185512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.185763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.186008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.186239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.186489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.186751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.187000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.187244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.187471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.187699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.187929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.188165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.188482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.188693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.188887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.189110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.189369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.189586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.189812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.190055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.190288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.190520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.190756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.190981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.191208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.191436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.191727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.191913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.192098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.192332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.192615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.192841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.193075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.193309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.193554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.193781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.194018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.194256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.194493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.194725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.194960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.195187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.195434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.195666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.195899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.196130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.196440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.196655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.196854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.197155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.197536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.197934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.198134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.198374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.198647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.198887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.199073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.199364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.199564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.199825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.200063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.200304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.200538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.200817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.201021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.201286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.201531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.201735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.201951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.202239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.202597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.202747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.202932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.203169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.203407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.203642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.203879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.204113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.204343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.204584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.204825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.205058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.205286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.205510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.205785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.205989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.206225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.206478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.206738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.206977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.207206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.external = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.207435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.207733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.207961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.208192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.password = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.208503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] auth.token = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.208746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.208979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.209224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.209455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.209698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.209943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.210174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.210409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.210659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.210903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.211148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.211392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.211634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.211868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.212111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.212360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.212625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.212988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.213275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.213522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.213961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.214212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.214461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.214695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.214931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.215175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.215420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.215647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.215892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.216125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.216375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.216637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.216889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.217126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.217371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.217603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.217851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.218090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.218322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.218553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.218797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.219030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.219267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.219520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.219761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.219992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.220221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.220478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.220732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.221151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.221269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.221463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.221704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.222050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.222205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.222440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.222669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.222903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.223134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.223366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.223605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.223840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.224082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.224309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.224584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.224821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.225053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.225297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.225539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.225767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.226002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.226229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.226465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.226701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.226976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.227178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.227412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.227658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.227904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.228166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.228433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.228684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.229087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.229322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.229649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.230036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.230351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.230599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.230868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.231101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.231411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.231597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.231841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.232073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.232300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.232569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.232802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.233037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.233264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.233508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.233751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.233992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.234233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.234476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.234702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.234949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.235183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.235418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.235652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.235884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.236125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.236369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.236628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.236879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.237108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.237349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.237582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.237814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.238048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.238433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.238674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.238907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.239147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.239388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.239637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.239885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.240123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.240373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.240647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.240886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.241132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.241370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.241610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.241845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] role.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.242090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] role.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.242320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.242568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.242813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.243057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.243307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.243703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.244101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.244444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.244713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.244956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.245205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.245454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.245703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.246000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.246445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.246683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.246932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.247182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.247430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.247681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.247917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.248177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.248464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.248708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.248936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.249169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.249399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.249650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.249901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.250148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.250388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.250621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.250856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.251089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.251326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.251570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.251804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.252057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.252301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.252563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.252778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:06:15.252778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: from cryptography.utils import int_from_bytes Aug 29 20:06:15.253376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.253376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.253623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 20:06:15.253623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: from cryptography.utils import int_from_bytes Aug 29 20:06:15.253835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.253835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.253835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.254162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.254162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.254431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.254661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.254904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.255169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.255431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.connection = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.255675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.255922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.256159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.256411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.256655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.256891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.257235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.257499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.257747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.257984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.258227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.258462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.258710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.258945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.259190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.259418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.259861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.260385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.261106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:06:15.290228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.290461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.290616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.299383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.303822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 20:06:15.304024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 20:06:15.304219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] command line args: [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 20:06:15.304536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 20:06:15.304718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ================================================================================ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 20:06:15.304977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] admin_token = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.305227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_dir = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.305402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.305587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] config_source = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.305769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] debug = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.305986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.306225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.306403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.306725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.310175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.310452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.310652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_config_append = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.310832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.311024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_dir = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.311231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.311485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.311749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.312005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.312261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.312485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.312730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.312979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.313232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.313472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.313711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.313950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.314171 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.314423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.314671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.314951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.315471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.315658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] publish_errors = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.315894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.316128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.316305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.316588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.316828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.317070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] standard_threads = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.317304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.317551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.317728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.317904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_journal = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.318077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_json = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.318251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_stderr = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.318425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] use_syslog = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.318659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 20:06:15.318920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.319158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.319422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.319663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.320009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.320163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.320437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.320681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.320928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.321179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.321431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.321670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.321968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.322316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.323172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.323446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.323702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.323961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.324225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.324510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.324756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.325015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.325282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.325540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.325837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.326074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.326304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.326536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.326776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.327028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.327280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.327513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.327748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.327996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.328078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.328245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.328336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.328512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.328767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.329002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.329240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.329479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.329713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.329946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.330178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.330410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.330650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.330914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.331151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.331392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.331624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.331863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.332101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.332352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.332609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.332852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.333093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.333334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.333621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.333917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.334267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.334402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.334643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.334883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.335115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.335379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.335619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.335852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.336092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.336328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.336627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.336870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.337120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.337370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.337618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.337998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.338875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.339136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.339385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.339632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.339936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.340125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.340508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.341534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.341534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.341534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.341534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.341899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.342264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.342619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.342877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.343126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.343365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.343613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.343858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.344108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.344349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.344614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.344846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.345080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.345322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.345556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.345801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.346039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.346286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.346533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.346791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.347053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.347294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.347528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.external = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.347811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.348156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.348404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.348644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.password = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.348880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] auth.token = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.349123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.349363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.349609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.349845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.350102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.350356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.350591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.350833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.351082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.351334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.351585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.351902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.352189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.352447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.352701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.352953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.353195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.353483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.354459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.354720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.354990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.355238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.355499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.355740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.355985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.356236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.356514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.356810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.357113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.357315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.357578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.357817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.358079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.358322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.358666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.358904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.359156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.359407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.359647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.359893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.360141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.360370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.360640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.361022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.361290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.361528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.361763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.362003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.362254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.362548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.362844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.363104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.363362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.363642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.363882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.364129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.364369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.364644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.364878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.365129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.365378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.365623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.365876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.366110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.366363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.366613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.366852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.367199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.367450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.367684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.367930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.368163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.368428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.368678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.368988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.370979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.371155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.371374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.371711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.371973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.372188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.372433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.372685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.372958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.373191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.373436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.373684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.373935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.374169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.374404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.374641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.374875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.375119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.375349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.375598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.375849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.376098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.376338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.376621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.376942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.377209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.377524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.377700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.377916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.378160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.378404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.378653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.378894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.379152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.379388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.379637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.379879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.380116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.380359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.380645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.380890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.381125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.381366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.381610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.381864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.382116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.382360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.382615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.382963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.383201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.383446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.383614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.383740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.383919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.384162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.384428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.384694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.384988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.385857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.386114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.386368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.386624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.386876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.387130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.387471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.387710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.387962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.388222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.388508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.388761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.389200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.389447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.389710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.389973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.390228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.390487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.390735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.390994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.391252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.391498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.391735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.391972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.392208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.392494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.392755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.393104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.393347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.393589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.393827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.394068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.394313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.394561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.394801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.395061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.395312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.395554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.395805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.396051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.396301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.396569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.396813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.397052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.397302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.397597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.397834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.398082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.398352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.398615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.398864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.399115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.399358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.399603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.400133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.400642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.401381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.401640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.401907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.402224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.402505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.402745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.403017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.403249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.403504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.403741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.403986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.404227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 20:06:15.404420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 20:06:15.433870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.434108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.434108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.434332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.434332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.443290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.463898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.464103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.506883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.552232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.552620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.596080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.596305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.596542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.596759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.596974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.597186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.600681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.600900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.601122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.601344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.601566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.601782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.621727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.621977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.622177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.622348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.622563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.622773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.622985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.624121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.624426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.624697 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.624923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.625148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.627228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.627473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.634878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.636767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.648505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.648750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.648946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.649164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.649373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.649582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.650096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.668868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.669139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:06:15.669418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.669615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:06:15.669890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.670155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.670411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.670666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.680638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.680938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.681208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.681593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.689270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.692335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.692653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.692934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.693219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.693499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.693760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.694030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.694328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.694572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.694844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.695107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.720005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.721580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.721858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.726586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.726858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.727144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.734084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.734358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.738388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.738679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.738928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.739211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.739515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.741780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.742066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.742344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.746443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.746668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.746904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.747124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.747344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.747552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.747769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81650) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 20:06:15.758225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.758455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.761065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.761417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:06:15.761998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.762308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 20:06:15.762714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.762860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.763121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.763544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.763969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.771468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.771468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.771468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.773925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.775489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.775745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.776667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.776967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.777665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.777884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.778134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.778425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.778688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.779084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.784339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.787382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.787664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.787953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.788242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.788552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.788816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.789178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.789456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.789733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.790013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.790283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.795059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.795406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.795667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.796067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.802814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.804500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.806074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.806358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.809550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.809836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.810120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.810409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.810709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.816265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.817931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.818219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.822010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.822479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.822847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.823128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.823410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.823663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.823780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.823953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.824067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.824239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.830985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.831275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.835371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.835666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.835983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.836266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.836559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.836951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.837909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.837909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.839780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.842854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.845734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.847148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.848597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.848887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.849205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.855379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.855689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.856582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.858066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.859733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.860968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.861259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.861538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.861811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.863132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.863438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.867918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.870088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.870391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.870674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.872268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.875657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.875960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.876256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.876583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.876986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.877267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.877887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.878192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.878473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.878749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.879019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.879292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.879644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.879905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.880295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.880788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.881248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.881689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.882141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.882601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.895174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.895464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.895736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.896000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.904315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.907708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.909469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.909847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.912795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.913093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.913390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.913768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.914066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.918836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fcce8759c0 pid: 81651 (default app) Aug 29 20:06:15.922659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8287-52b3-4f55-96b5-e22f1ee36817 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:15.922944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8287-52b3-4f55-96b5-e22f1ee36817 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:15.923214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8287-52b3-4f55-96b5-e22f1ee36817 None None] PATH_INFO: `/v3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:15.926944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.927442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.927738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.928368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.928581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Aug 29 20:06:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:15.928687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.928857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.929231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.957631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.963187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.970386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.972889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.975038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.975353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.975811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.986576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.988168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:15.991497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.991815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.992085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:15.992381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.002991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:16.003311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.003591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.013548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81650) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 20:06:16.013951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.014383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.014684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.015037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.015334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.015658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.016081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.016378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.016679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.016960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.017225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.017498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.017766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81650) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 20:06:16.066458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fcce8759c0 pid: 81650 (default app) Aug 29 20:06:23.644853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.645730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.645730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.647223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:23.656874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.657628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.657628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.731109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: INFO dbcounter [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] Registered counter for database keystone Aug 29 20:06:23.752422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:06:23.759353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writer thread running {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:06:23.950438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG passlib.handlers.bcrypt [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81650) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:06:23.950698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG passlib.handlers.bcrypt [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81650) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:06:24.011470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:24.013132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:24.175162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 20:06:24.704887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:24.788613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: INFO dbcounter [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] Registered counter for database keystone Aug 29 20:06:24.814340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG oslo_db.sqlalchemy.engines [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 20:06:24.821339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writer thread running {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 20:06:24.947947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167193-c5f5-44a2-bb5f-7fdacb29d92b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:24.952288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.952969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.953274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.953545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.963110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:25.016297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:06:25.016637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee12f8-a75f-4c86-bfb4-a50f271d498a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:25.028230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Aug 29 20:06:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:06:25.034689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:25.052462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3deec7-85b8-437e-b8cf-3bac19939576 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:25.058753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:25.060173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:25.060518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:25.062021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] PATH_INFO: `/v3/projects/02370ea83738498ab52b54a7db5f2ba5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:25.062480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] RBAC: Authorizing `identity:get_project(project_id=02370ea83738498ab52b54a7db5f2ba5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:25.120101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 20:06:25.120551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0018598-cc9b-435d-a90d-a1f99903a22a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:25.125775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 2/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Aug 29 20:06:25 2022] GET /identity/v3/projects/02370ea83738498ab52b54a7db5f2ba5 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:27.755908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed80cd-e749-4595-8923-885ce0c4197c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.756486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed80cd-e749-4595-8923-885ce0c4197c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.756909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed80cd-e749-4595-8923-885ce0c4197c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.763439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 4/6] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:27.769578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.770194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.770194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.795807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:27.797393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:27.808014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 20:06:28.078749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed80cd-e749-4595-8923-885ce0c4197c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:28.094050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed80cd-e749-4595-8923-885ce0c4197c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:28.098530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:28.099157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:28.099426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:28.099696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:28.108878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:28.110673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed37aba-85ae-440e-8d7f-513546561149 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:28.121068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Aug 29 20:06:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:06:28.127721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:28.139016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e5e5-d5e4-41b0-b291-a84f3f861375 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:28.144688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:28.145403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:28.145679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:28.145950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:28.147489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:28.149735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a5b1e-6866-41bd-81ba-31b62551e4a8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:28.151657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 4/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Aug 29 20:06:28 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:30.347676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b818c-e1c1-4bb1-a4a4-ec4f1883bbd1 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.348377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b818c-e1c1-4bb1-a4a4-ec4f1883bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.348377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b818c-e1c1-4bb1-a4a4-ec4f1883bbd1 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:30.349570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:30.355605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.356151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.356151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:30.376479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:30.377695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:30.459708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828aac-9bd4-417a-83ee-c9fa5fd07a99 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.460174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828aac-9bd4-417a-83ee-c9fa5fd07a99 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.460724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828aac-9bd4-417a-83ee-c9fa5fd07a99 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:30.463199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 7/11] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:30.472063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.472590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.473070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:30.478900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 5/12] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:30.545040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG passlib.handlers.bcrypt [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81651) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 20:06:30.545690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG passlib.handlers.bcrypt [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81651) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 20:06:30.600913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:30.603359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:30.748766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 8/13] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:30.758804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:30.790466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:30.934037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5166c-fb04-4599-bdc0-592cbc3ae32d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:30.981182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:30.981819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.982090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.982364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.078283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:31.079809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:31.110918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:31.205091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 6/14] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:06:31.211704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.222153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.364830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011733-5276-4cb1-8e54-c1f6a63bad1b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:31.369115 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:31.393832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb15f1-7f64-4054-85c7-7d6a84663d74 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:31.431286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:31.433372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:31.434922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.435325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.435707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.453055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:31.454110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.454725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.455432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.457560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:31.459398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:31.476471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:06:31.479467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:31.480672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:06:31.481721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:06:31.481721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:31.481721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:31.481721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 9/15] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:31.487224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:31.494407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:31.496696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:06:31.498255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 7/16] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:31.503809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.631416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dbbfe-3379-4823-bab1-cc7b24523791 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:31.636077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a4f3-c3e7-4f0c-bbaa-e2c495ca4a39 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:31.678435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:31.679152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:31.679358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.679637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.679885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.680051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.680235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.680569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.681043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:31.681590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:31.681765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:31.682162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:31.683553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:31.684091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:31.696704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:31.702915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.708530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:31.769293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:31.857516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c69b1d-50df-4955-ae13-4d359882271b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:31.920430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:31.921560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:31.922044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:31.922526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:31.924742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:31.927527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:31.930411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:31.937642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:31.964947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.101730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcaf31-4a16-4b6b-9ac1-e03716feb1bb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:32.148835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:32.149939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.150331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.150602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.152731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:32.154327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5f328-8818-457b-904c-57b2029f6707 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:32.155990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:32.166652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:32.313884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7aac3-3580-46be-802f-acea82700761 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:32.329834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:32.356694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:32.357671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:32.358116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:32.358564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:32.359463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.domain.id=default, user.id=f8200bcf27da433fa27fff3a3ac11f6b) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:32.359940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:32.361745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda31f3e-c37a-4dd3-81bf-eac0482aed67 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:32.371499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Aug 29 20:06:32 2022] GET /identity/v3/role_assignments?user.id=f8200bcf27da433fa27fff3a3ac11f6b&scope.domain.id=default&role.id=094fcef4654043758d8a01fad877074a => generated 233 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:35.063900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471bed-633c-498d-bc30-37f93cca6125 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.065387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471bed-633c-498d-bc30-37f93cca6125 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.066111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471bed-633c-498d-bc30-37f93cca6125 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.069224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:35.078480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4d5c-6006-4f34-be00-92aa682e3175 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.080137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4d5c-6006-4f34-be00-92aa682e3175 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.080903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f4d5c-6006-4f34-be00-92aa682e3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.116885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d02f4d5c-6006-4f34-be00-92aa682e3175 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:35.119078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d02f4d5c-6006-4f34-be00-92aa682e3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:35.245552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:35.290502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4819-48a5-4ab9-8a48-594cdc8e83e5 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.291615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4819-48a5-4ab9-8a48-594cdc8e83e5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.292275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a4819-48a5-4ab9-8a48-594cdc8e83e5 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.294492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:35.302230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b690e3-218e-47f8-8dd9-7d7c5f116297 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.303142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b690e3-218e-47f8-8dd9-7d7c5f116297 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.303893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b690e3-218e-47f8-8dd9-7d7c5f116297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.328369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-94b690e3-218e-47f8-8dd9-7d7c5f116297 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:35.330529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-94b690e3-218e-47f8-8dd9-7d7c5f116297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:35.434342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:35.828299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a4819-48a5-4ab9-8a48-594cdc8e83e5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:35.839595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698b24-1c47-4daa-83d1-9fa7e1e97ee0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.840326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698b24-1c47-4daa-83d1-9fa7e1e97ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.844828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698b24-1c47-4daa-83d1-9fa7e1e97ee0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.850803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:35.852798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:35.854700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:35.855206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:35.905645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:35.907940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:36.028432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.053378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.101888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a4819-48a5-4ab9-8a48-594cdc8e83e5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.114135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:36.115796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.159946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.161038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.161533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.162012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.163008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.164856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.323779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfde3c-eecf-4085-918b-278671c4b996 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.373943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 14/28] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:35 2022] POST /identity/v3/roles => generated 219 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:36.430708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.431494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.431776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.432049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.454305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.456476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:06:36.483418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:36.484463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:06:36.485336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:06:36.485336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:06:36.485336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:06:36.485336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:36.491966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.560542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.612643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.695352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f8b6-ad9d-470d-b4bc-d7c917174cdf None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.742980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.743685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.744024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.744298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.745025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:36.745354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.746978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698716-6b56-4cb3-9012-25c37be0bd90 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.761875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:36.764183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd2d2-a1c6-4e1b-b745-17fbbae9a632 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.765166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd2d2-a1c6-4e1b-b745-17fbbae9a632 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.765662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd2d2-a1c6-4e1b-b745-17fbbae9a632 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.767755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:36.768991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd2d2-a1c6-4e1b-b745-17fbbae9a632 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:36.775046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:36.787910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eaea2-b30f-487f-9ff1-f847704a8707 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.839203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.839922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.840202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.840505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.841294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.842783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a7f3f-f4c6-4bbb-8556-501edb3b2d7d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.923336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd2d2-a1c6-4e1b-b745-17fbbae9a632 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:36.968530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 16/32] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:36 2022] POST /identity/v3/roles => generated 225 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:06:36.970152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeeb00-4fd3-4643-8118-926d308087fb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.970454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeeb00-4fd3-4643-8118-926d308087fb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.970733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afeeb00-4fd3-4643-8118-926d308087fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.992590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:36.993894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:36.994531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:36.995174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:36.996454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:36.997393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4afeeb00-4fd3-4643-8118-926d308087fb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:36.998499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1b779-51dd-40dc-a509-a908c15a0d4a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:36.999041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4afeeb00-4fd3-4643-8118-926d308087fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:37.048577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 17/33] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:36 2022] POST /identity/v3/projects => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:37.050466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965423d-2b79-41f7-8bb7-c04ad07e2131 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.050901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965423d-2b79-41f7-8bb7-c04ad07e2131 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.051078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965423d-2b79-41f7-8bb7-c04ad07e2131 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.053049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 18/34] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:37.066431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.067030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.067416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.109782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:37.112133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:37.141242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:37.143505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fad6b-7c58-4d0d-be76-cce525f5ad71 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.144002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fad6b-7c58-4d0d-be76-cce525f5ad71 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.144461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fad6b-7c58-4d0d-be76-cce525f5ad71 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.146576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:37.156436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.156436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.156436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.190095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:37.191715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:37.194355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.221651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.261655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:37.308674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:37.562994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.579936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.685128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14606-f99e-4654-bea5-96adaf62aa6b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.711327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714741-febd-4724-8ff1-95893a69d752 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.726169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.726859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.727155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.727434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.741629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:37.749227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:37.750487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:37.751867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:37.755439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 20/39] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:37.756482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.757200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.757847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.758134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.758379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.759067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:37.760720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:37.772506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.779953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:06:37.786208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.829180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:37.907623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4a94-5f8d-4431-9034-54cea84a7009 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.933087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876870-ff99-4234-bd8a-203ed969f36d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:37.956453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.956693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.956884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.957156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.958883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:37.961423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:37.964248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 21/41] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:37.970975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:37.990169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:37.991225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.995122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.995122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.995122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:37.995122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:37.995122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.004708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 21/42] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:38.013235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:38.128908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0fb7-4140-4fbf-bcae-d3812882075d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:38.147248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:38.183412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:38.184102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:38.184458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:38.184676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:38.185351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:38.186860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.211098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:38.217022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/projects => generated 312 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:06:38.271239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746f95-5521-4e99-afc6-069bf0545f86 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:38.324337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:38.325227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:38.325606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:38.325952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:38.327426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:38.329133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.330992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:38 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:38.337235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:38.472188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c479-6523-408a-9308-c8684e1744a2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:38.513284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:38.513926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:38.514204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:38.514472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:38.515611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:38.517129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b8da-dc7d-49b9-a9b2-bbaf78e62a15 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.518750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:38.526031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:38.647597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e587-fe57-493b-ac88-ddab91152c40 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:38.683040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:38.694555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:38.695414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:38.695721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:38.696008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] PATH_INFO: `/v3/domains/default/users/f8200bcf27da433fa27fff3a3ac11f6b/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:38.699081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8200bcf27da433fa27fff3a3ac11f6b, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:38.700624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451de3-441c-4212-8605-52cae11b5e33 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.716900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 23/46] 10.222.0.20 () {58 vars in 1361 bytes} [Mon Aug 29 20:06:38 2022] PUT /identity/v3/domains/default/users/f8200bcf27da433fa27fff3a3ac11f6b/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:40.610086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f5ab-e3fc-4a18-9712-060f05b3bafa None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.610663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f5ab-e3fc-4a18-9712-060f05b3bafa None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.610663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f5ab-e3fc-4a18-9712-060f05b3bafa None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.612083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:40.617973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.619260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.619260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.642254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:40.643892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:40.660319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a7ac-79b8-4c66-804d-40eedf061905 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.660679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a7ac-79b8-4c66-804d-40eedf061905 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.660956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0a7ac-79b8-4c66-804d-40eedf061905 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.662265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 25/48] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:40.669107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.669529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.669823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.692380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:40.694279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:40.723702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 24/49] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:40.733397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:40.794577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:40.993037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.093966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.130904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b8a09-1276-451c-83a1-5a3c64affcb5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.153700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.177061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.177718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.177994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.178257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.179424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.181289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.183254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:41.189060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.210794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b074e-afdc-403a-9e98-40a85251b5c2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.255055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.255833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.256270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.256781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.272784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:41.282415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:41.283350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:41.284111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:41.284750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:41.290840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.321533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.323141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f7fe-c07b-4218-8cdf-4b5735c0b08f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.362124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.362749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.363034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.363308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.363981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.365501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.401783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 26/53] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Aug 29 20:06:41 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:41.403340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ba050-309f-43b5-a28c-7c73c5fac260 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.445968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.446549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.446961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.447512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.448232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:41.448501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.449963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.464983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:41.470991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.526129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.599562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964e360-524d-45de-96b7-676c9e372c30 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.639631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.640496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.640496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.640734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.642081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.643411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:41.654168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.758108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.776505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796c2eb-1e39-4ea3-bf43-5b79e651d210 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.817210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.818189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.818465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.818728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.819893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.821399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3d299-f06e-4769-aaad-abb389b565ea None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.823846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:41.831128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.961186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55a06-a5f1-430b-90ed-9bcdcd016b97 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.972302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:42.004671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:42.005317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:42.005603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:42.005878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:42.006855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.domain.id=default, user.id=f8200bcf27da433fa27fff3a3ac11f6b) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:42.006988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:42.008433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a061d2-0ff0-4166-810b-b6f7da83da72 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:42.017036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/role_assignments?user.id=f8200bcf27da433fa27fff3a3ac11f6b&scope.domain.id=default&role.id=094fcef4654043758d8a01fad877074a => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.373807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821b47-a614-4a0a-8673-739f607c4a76 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.374343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821b47-a614-4a0a-8673-739f607c4a76 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.374343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9821b47-a614-4a0a-8673-739f607c4a76 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.375679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:43.381744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.382528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.382528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.402230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:43.403642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:43.474263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:43.745168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821b47-a614-4a0a-8673-739f607c4a76 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.859677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9821b47-a614-4a0a-8673-739f607c4a76 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.896894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.897526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.897797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.898056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.899168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:43.901171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e91cf1-3252-4820-a8ee-74fefbd23075 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:43.903110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:43.909016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:44.018857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.022041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9402968-9db0-455e-8e02-7910aa6252d2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.065106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.065728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.066032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.066289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.066952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.068470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2ceb-3527-48bd-a602-e2b9f340d15e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.100284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/users => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:47.773778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72f73-1eac-4d22-9fd2-5d20d5c12598 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.775642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72f73-1eac-4d22-9fd2-5d20d5c12598 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.776357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f72f73-1eac-4d22-9fd2-5d20d5c12598 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.778055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:47.783978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035eaef-376f-4a6f-ace3-e19f6dd02579 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.784937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035eaef-376f-4a6f-ace3-e19f6dd02579 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.785409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035eaef-376f-4a6f-ace3-e19f6dd02579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.813814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1035eaef-376f-4a6f-ace3-e19f6dd02579 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:47.815482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1035eaef-376f-4a6f-ace3-e19f6dd02579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:47.842869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d3f7-00f7-4cd4-8b87-9454ed3e87e2 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.843204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d3f7-00f7-4cd4-8b87-9454ed3e87e2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.843409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76d3f7-00f7-4cd4-8b87-9454ed3e87e2 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.845202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:47.850870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be34bdf-e382-44ab-bd21-2485dde9e9e9 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.851142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be34bdf-e382-44ab-bd21-2485dde9e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.851399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be34bdf-e382-44ab-bd21-2485dde9e9e9 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.853410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:47.854297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.854582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.854846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.936655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:47.939581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70d16-88fd-4f64-aff4-4c07c488e30f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.940505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70d16-88fd-4f64-aff4-4c07c488e30f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.941302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e70d16-88fd-4f64-aff4-4c07c488e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.975734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d0e70d16-88fd-4f64-aff4-4c07c488e30f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:47.979292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d0e70d16-88fd-4f64-aff4-4c07c488e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:47.992722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:47.994048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:48.015228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.116119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:48.117810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e065e-b497-4b7e-b4d7-8db1d83baf29 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.118485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e065e-b497-4b7e-b4d7-8db1d83baf29 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.119050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e065e-b497-4b7e-b4d7-8db1d83baf29 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.120907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 33/67] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:48.122517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:48.131135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.131706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.132184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.182422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:48.184301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:48.216241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.360727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:48.508473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.550218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.730800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248bf85-b492-414d-bb0b-1e33bebcf382 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.737686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2def853-0104-4291-8fb3-8fbd51ac764f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.791800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.792699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.793155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.793589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.804740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.805701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.806198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.806663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.814626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-af682db6-0d50-4422-adf4-9727af050206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:48.824562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:48.826340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:48.827959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:48.829282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398234-2a25-40f9-be6d-12982fdf60fc None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.829415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398234-2a25-40f9-be6d-12982fdf60fc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.830459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398234-2a25-40f9-be6d-12982fdf60fc None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.837036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 37/71] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:48.837036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398234-2a25-40f9-be6d-12982fdf60fc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.838859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:48.847706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:48.852673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 35/72] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:06:48.854359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:48.865017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.870665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.985364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398234-2a25-40f9-be6d-12982fdf60fc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.008881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcc7f4-29a4-4986-a059-4b2fa41e0b54 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.028793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.029185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.029459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.029720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.043894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-4ad636ad-7305-4e45-ad93-977558ff491a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:49.049035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:49.049969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:49.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:49.052191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.052191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.052191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.073678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:49.074913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:49.075714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.076631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.076958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.077259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.078379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:49.078754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.080724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.100006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.103809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.163564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:49.165019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.173441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.200098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.264029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e79f-038e-460b-9009-679b76087483 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.323478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.324455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.324946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.325421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.326771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:49.327280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.330070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.346547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 37/76] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.348008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.352757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3dc2a-f2ff-42d2-a777-c9fd96d17e48 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.413175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.414255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.414736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.415205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.439256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:49.446206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:49.448621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 40/77] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:49.449598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.529609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b4d1-de3d-4313-88f6-aae69b53d434 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.539104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.564156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.581953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.582884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.583375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.583856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.584902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:49.585213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.586768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.596854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 38/78] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.597719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.601761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab516-c1a6-4425-80bc-22e01a7d4d26 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.657299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.657612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.657876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.658146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.676083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.677606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.679564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 41/79] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.680158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.744154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c766-24c2-47d8-8a05-8d9350be722a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.796631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.797288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.797574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.797853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.799035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.801206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.809758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 39/80] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.809758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.819858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c9313-9d11-4145-b492-ed1e8b4ea0e9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.842850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.861438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.862061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.862343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.862609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.863287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:49.863591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.865053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:49.875921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:49.876904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:49.887680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:49.948494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08aa5-7583-4aa8-a2d5-df16f9eacc6d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:49.993493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:49.994282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:49.994620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:49.995043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:49.996671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:49.998600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.000863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 40/82] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.001308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.037486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fb531-285b-4f10-957d-959fdf8f1562 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.092707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.093852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.094266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.094760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.096784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.099486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.102765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 43/83] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:49 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.104439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.139652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2909-052f-4148-86f7-ebc153299a58 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.173397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.174780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.183071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.183722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.184005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.184288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.238367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5bf08-f4a0-4366-a8c0-faec5b92a158 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.270698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.272455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.276800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.277456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.277728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.278003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.358371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.360591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.403831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:50.405706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.421013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.458741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.507463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:50.508063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.555199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29734b9-9d8f-4ec5-8fba-6fa3e290cbc8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.594580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.595226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.595508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.595798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.597005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.598509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.600156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 42/86] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.600994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.636093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd0b3-9682-4619-8d69-d7271a93c5cd None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.685588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.686211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.686497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.686761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.687435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.688951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.732336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 45/87] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:50 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:50.732970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.734752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:50.745230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:50.745532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139f511-5cfc-4421-892f-45cbac965123 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.798759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.799405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.799718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.800013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.913617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.916576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.923535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c96a2-157b-43a4-89a1-aef3588c6653 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:50.982665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:50.983530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.984043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.984604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] PATH_INFO: `/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.986713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] RBAC: Authorizing `identity:get_project(project_id=befe2bc3ac4043c0a0d36b1eb5fea538)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:50.989660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:50.993075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 46/88] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:50.998341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.057106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.074731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 43/89] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:51.076307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.110290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.146711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea426343-8c44-4834-b7e7-4b52415a7bbb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.193805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.194376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.194656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.194933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.196200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.198031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.200192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 47/90] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:50 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.201057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.269603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4cb-ade4-4dfe-aa5b-733057d30f79 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.320625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.321272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.321553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.322151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.415575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02807206-ada0-4db3-bfb8-a3d520515383 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.427777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.440042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.442504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.463334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.464300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.465135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.465629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.467083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=befe2bc3ac4043c0a0d36b1eb5fea538, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:51.467645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.470649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.485043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 48/91] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=befe2bc3ac4043c0a0d36b1eb5fea538&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.486595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.501660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.568094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 44/92] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:51.569325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.711370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd47b-9885-4731-b9ca-b1e9bdc9dc3e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.768599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.778316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cb4e1-bd62-4fef-9c7e-579afe23d41f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.829016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.834918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.834918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.834918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.835399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.835399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.835399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.835399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.835872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=f8200bcf27da433fa27fff3a3ac11f6b) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:51.835872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.840451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.840451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.841534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 49/93] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.842341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.843100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.852303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 45/94] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/role_assignments?user.id=f8200bcf27da433fa27fff3a3ac11f6b&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:51.857201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.104248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.179853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbdb57-364a-4d71-9e92-f279edbf056b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.185984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbd224-0669-4d89-a1cc-174a50236ea3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.256804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.257721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.258365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.258788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.259914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:52.260434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.262349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.269996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=acda13de619a41d5b6fafe2f998424fb => generated 259 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.271560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.272222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.272545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.272813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.273996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.276948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664d432-9182-47e5-87fd-6f29977b4c9d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.280192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:52.289911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:52.361837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:52.476133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5f56-3150-4c9c-8bf2-01d3e319ff04 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:52.537182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:52.538054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:52.538338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:52.538617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:52.539424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:52.539742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:52.541424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6ec9-8a79-4b59-a11b-016cb270c16d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:52.550737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:52 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:53.868096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be4de-4ce4-41cd-90ba-8a1c4442846c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.868782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be4de-4ce4-41cd-90ba-8a1c4442846c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.868782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503be4de-4ce4-41cd-90ba-8a1c4442846c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.870202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:53.876085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596d7a-fc80-4016-a74a-b27f0ab0495a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:53.876725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596d7a-fc80-4016-a74a-b27f0ab0495a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:53.876725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596d7a-fc80-4016-a74a-b27f0ab0495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:53.896267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-88596d7a-fc80-4016-a74a-b27f0ab0495a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:53.901814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-88596d7a-fc80-4016-a74a-b27f0ab0495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:54.005988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:54.166694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2b84-71e1-49c0-95f5-d794404dd928 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.166999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2b84-71e1-49c0-95f5-d794404dd928 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.167324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca2b84-71e1-49c0-95f5-d794404dd928 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.169034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 52/100] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:54.175496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.176385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.177170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.215468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:54.217995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:54.251569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.361641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:54.671894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2b84-71e1-49c0-95f5-d794404dd928 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.824328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca2b84-71e1-49c0-95f5-d794404dd928 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:54.873013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:54.874021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.874021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.874249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.890370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:54.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:54.897762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:54.899739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:54.905971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.926179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:54.929968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.134843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676afeb-225c-4f71-88d9-9d4960445c4c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.177864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421dab-4a7e-4e8b-811c-21fbee5604c3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.185394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.186160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.186542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.186824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.188155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.189724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bd6eb-7710-4aff-a714-7768d4bbb3e9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.194236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 54/103] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.196038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf7dc-6254-4457-8725-e001601ea95a None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.197620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf7dc-6254-4457-8725-e001601ea95a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.198132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bf7dc-6254-4457-8725-e001601ea95a None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.206226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 55/104] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:55.207641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bf7dc-6254-4457-8725-e001601ea95a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.258926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.260515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.261312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.261981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.263318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:55.264146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.266767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14019e5c-ceb0-44f0-8f82-cdddffff16cf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.279163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 50/105] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.280872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.281435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.281916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.305593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:55.307892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:55.316822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.420796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.468044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 51/106] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:55.469406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.557222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bf7dc-6254-4457-8725-e001601ea95a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.695429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.696475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.697145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.697838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.699005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.702639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed41b8-e834-484e-b8cc-4f2eaa73161a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.768774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 56/107] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:06:55 2022] POST /identity/v3/projects => generated 302 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:06:55.768774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca032f-54d4-4a7c-bcd2-ec6239e7eec1 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.768774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca032f-54d4-4a7c-bcd2-ec6239e7eec1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.768774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca032f-54d4-4a7c-bcd2-ec6239e7eec1 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.771537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 57/108] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:55.773680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827a13b-a8ff-4269-a694-6c3faa5bd1f1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.792593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.793042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.793495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.848886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.850096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.850599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.851140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] PATH_INFO: `/v3/users/91d34538760547ffa0705c97a3ad545d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.868886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:55.871697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:55.880823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.893361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=91d34538760547ffa0705c97a3ad545d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:55.895403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:55.897855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 52/109] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/users/91d34538760547ffa0705c97a3ad545d => generated 289 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:55.899651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.077890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 58/110] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:56.084437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.163788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc13b-9eb1-4e9c-a959-d4d8d63f1cb3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.210114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.223698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.225138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.226006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.226792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.248964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e10b2cc9-dac1-49ea-b210-e2f5c462d67c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:56.259370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:56.261095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:56.262626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:06:56.266102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 53/111] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:56.269537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88d94-7da9-4721-990a-a5f53dcc5e2b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.270267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88d94-7da9-4721-990a-a5f53dcc5e2b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.271035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c88d94-7da9-4721-990a-a5f53dcc5e2b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.274019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 54/112] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:56.289367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.290263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.291029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.322586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be826a3-1d6b-4d18-b51f-0d3266cfd8bf None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.329024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:56.331356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:56.382729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.383824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.384236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.384754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.450523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.477266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.479284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f827-9e95-49ec-91a7-1ec2cb18ec1b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.482685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:06:56.484295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.560568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.654949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4e1d5-6867-494c-a777-5e97fdba12cd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.655575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 59/114] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:06:56.657916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726b87-a22c-4b05-bd86-eea36e8a7010 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.658476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726b87-a22c-4b05-bd86-eea36e8a7010 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.658959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48726b87-a22c-4b05-bd86-eea36e8a7010 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.661798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 60/115] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:56.669191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48726b87-a22c-4b05-bd86-eea36e8a7010 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.711674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.712918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.713340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.713803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.715047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:56.715548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.718190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.735417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 56/116] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:56.740452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:56.832083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.834129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48726b87-a22c-4b05-bd86-eea36e8a7010 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.882034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.882752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.883141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.883413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.898480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7096e810-c4e5-457a-9d77-10b81f562781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:56.904767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:56.905741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:56.906591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:56.909891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.910426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.911183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.924198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310fea3-1e55-49cb-a94c-3a63f23bae61 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:56.932544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:56.933798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:56.945073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.968244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:56.969342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:56.969833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:56.970311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:56.971858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.973754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.975936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 57/118] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:56.976849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.044295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 62/119] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:57.050991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.128379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5eff8-bf34-4f13-9fd7-05d4bd817a03 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.154298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.181483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.182412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.182503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.182726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.184187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.186026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.188488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:56 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.193447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.221503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21310d-8ae9-4fd9-87b6-bb910b478e2e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.281600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.283197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.283784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.285094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.311754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:57.321487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:57.323218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:06:57.325971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:57.333212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:57.338606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.342522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.381317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587873-67c1-4254-9240-822975ad0fd9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.431630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.432327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.432718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.433054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.433735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:57.434040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.435445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.452422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 59/122] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.452422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.484315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3510-ab3e-4f2f-b394-a51ae0644744 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.515598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.533354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.534428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.535030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.535537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.537045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=91d34538760547ffa0705c97a3ad545d) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:57.537631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.539908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.549172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 64/123] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/role_assignments?user.id=91d34538760547ffa0705c97a3ad545d&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.550282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.597411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d7d5-cc2e-4128-975d-a885bee79a6f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.654370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.669077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.669750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.670037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.670318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] PATH_INFO: `/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.671552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] RBAC: Authorizing `identity:get_project(project_id=befe2bc3ac4043c0a0d36b1eb5fea538)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.673104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.674857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 60/124] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.676128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.729750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfed40-5688-43ca-ab87-a6e6bfc39acc None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.802565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.804429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.805131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.805866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.820812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109169-7786-4c0d-9c1a-49897f37ca87 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:57.828452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:06:57.835418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:06:57.836374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:06:57.837189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:06:57.840679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 65/125] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:06:57.841826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:57.852248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:57.893257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e308a-359d-41de-9048-663bfa435440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:57.894794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e308a-359d-41de-9048-663bfa435440 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:57.896155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e308a-359d-41de-9048-663bfa435440 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:57.896745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e308a-359d-41de-9048-663bfa435440 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:57.898598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e308a-359d-41de-9048-663bfa435440 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:57.899190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e308a-359d-41de-9048-663bfa435440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:57.902937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e308a-359d-41de-9048-663bfa435440 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:57.925525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 61/126] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:57.927646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e308a-359d-41de-9048-663bfa435440 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.058598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c8cdb-41fb-4c01-9371-e7d1173d0ee0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.120945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.141562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.142939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.143285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e308a-359d-41de-9048-663bfa435440 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.143948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.144673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.148375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.152523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.155944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 66/127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:57 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.158613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.206177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.208534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.208996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.209485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] PATH_INFO: `/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538/users/ab915a38b89e4af49060b218b2868091/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.212593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] RBAC: Authorizing `identity:create_grant(project_id=befe2bc3ac4043c0a0d36b1eb5fea538, user_id=ab915a38b89e4af49060b218b2868091, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.216159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.240715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 62/128] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:57 2022] PUT /identity/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538/users/ab915a38b89e4af49060b218b2868091/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:58.242690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.327052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.373389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333a78-2146-46ec-a55e-f970cd81559e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.424291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d228-bfc4-43c5-8416-1dbd2cee7182 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.439995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.441389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.441920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.442495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.443884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:06:58.444651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.447951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.471748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 67/129] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.471748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.478769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.479823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.480338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.480905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.482451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.484142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e3ae-c9e7-4d2f-8e5d-e284e3534880 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.486680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 63/130] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.488289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b80f-726b-4e77-887f-cd58aab1969d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.488808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b80f-726b-4e77-887f-cd58aab1969d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.489377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b80f-726b-4e77-887f-cd58aab1969d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.491028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 64/131] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:58.492024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b80f-726b-4e77-887f-cd58aab1969d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.592854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.669980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1b4d-d4e4-409e-8d49-40997eda1ea9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.693442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b80f-726b-4e77-887f-cd58aab1969d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.712050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:58.733486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.734477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.735037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.735519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.737622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.739592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.741511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 68/132] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.742179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:58.773377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:58.774802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.775477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.776224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.779092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:58.782143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb413db-4b2a-4b24-bd8e-fb7e3125dcc9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:58.784513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 65/133] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:58.786308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:58.787221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:58.787988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:58.818269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:58.821064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:58.951054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:06:58.952429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073c25-b2fc-426c-a820-b91ab6c67bf1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:58.953190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.041134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.074413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.075070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.075348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.075685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.080632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.082158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.084007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 69/135] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:58 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:59.084920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.149614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1c95e-b476-4ebb-97c8-4d3a1b40ebff None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.157318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.250819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.251810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.251810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.252038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/users/f8200bcf27da433fa27fff3a3ac11f6b/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.255313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, user_id=f8200bcf27da433fa27fff3a3ac11f6b, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.257638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.288704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:58 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/users/f8200bcf27da433fa27fff3a3ac11f6b/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:59.289243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.344452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ad65-7b97-425d-9066-9ffe18d846f9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.435614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.436831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.437120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.437402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.439066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.441209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.443719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 70/137] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:06:59.456385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.576049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1843da-1b57-40bc-888e-1ef6a3befe8d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.630330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.631228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.631520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.631795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/users/ab915a38b89e4af49060b218b2868091/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.634668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.636895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, user_id=ab915a38b89e4af49060b218b2868091, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.639567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.664115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:59 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/users/ab915a38b89e4af49060b218b2868091/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:59.704103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bcd17-4a9d-4517-9237-fd94a01db48f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.746410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.747189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.747503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.747784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/users/ab915a38b89e4af49060b218b2868091/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.750333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, user_id=ab915a38b89e4af49060b218b2868091, role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.751919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.774975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:06:59 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/users/ab915a38b89e4af49060b218b2868091/roles/acda13de619a41d5b6fafe2f998424fb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:06:59.786172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:59.830226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:59.924164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c3ae1-48a6-4076-ba35-11d3a0c878d5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:59.967055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:59.967779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:59.968057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:59.968367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:59.969621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:59.971169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf920c5-bc6e-4a84-ae09-c595b348d062 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:59.972836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:06:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:06:59.979249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:00.100505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190f48-3aa7-48c4-aada-ebb4821bec37 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:00.128651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:00.143547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:00.144174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.144476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.144748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.145425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:00.146898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073eee0-732b-4415-bdb8-c545d3e77aec None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:00.173527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:06:59 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:00.405484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb5633-55ac-42c8-ae12-b431a8536946 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.406237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb5633-55ac-42c8-ae12-b431a8536946 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.406237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb5633-55ac-42c8-ae12-b431a8536946 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.407441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:00.415226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:00.415653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:00.416055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:00.444590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:00.445786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:00.546855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:00.840205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb5633-55ac-42c8-ae12-b431a8536946 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:00.949929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:00.960450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb5633-55ac-42c8-ae12-b431a8536946 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.003910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.004801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.005078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.005348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.018148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:01.023093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:01.025536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:01.028861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:01.035035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.166002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4faf787-1368-4d11-b2e3-bb088b89b465 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.176959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:01.218210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.218832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.219112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.219376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.220056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:01.220455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:01.221869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:01.233801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 74/145] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:01.239591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.360515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a19ad-ddba-4811-8734-26967794df1d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.402264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.402924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.403199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.403466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] PATH_INFO: `/v3/users/91d34538760547ffa0705c97a3ad545d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.404705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=91d34538760547ffa0705c97a3ad545d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:01.406219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:01.408189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 72/146] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/users/91d34538760547ffa0705c97a3ad545d => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:01.413712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.559708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98416698-904f-4a95-b3d5-65c8c4c62fb3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.604318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.605087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.605446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.605701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.609590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:01.612206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175de5-b4b9-432c-a0c6-b96a3fea8924 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:01.615296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:01 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:01.621499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:01.668949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:01.788051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e9c6a-eb59-4d4a-8d4c-2145e3dc9ee9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:01.831195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:01.831766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:01.832070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:01.832305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/users/91d34538760547ffa0705c97a3ad545d/roles/39507246e6dd42d2ace529471fbe1b2a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:01.834325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, user_id=91d34538760547ffa0705c97a3ad545d, role_id=39507246e6dd42d2ace529471fbe1b2a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:01.835893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510461-a7f2-48dd-b40d-d1dd90882bcd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:01.852374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:01 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/users/91d34538760547ffa0705c97a3ad545d/roles/39507246e6dd42d2ace529471fbe1b2a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:02.509481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40752-074b-4dfe-931b-bf518ff3cd89 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.510210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40752-074b-4dfe-931b-bf518ff3cd89 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.510470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40752-074b-4dfe-931b-bf518ff3cd89 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.513310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 76/149] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:02.522058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:02.522842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:02.522842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:02.549102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:02.550337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:02.641733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:03.233237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40752-074b-4dfe-931b-bf518ff3cd89 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.322278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.472411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40752-074b-4dfe-931b-bf518ff3cd89 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.550793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.551335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.551609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.551875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.566888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:03.572376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:03.573982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:03.575510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:03.587272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.608771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.716963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f1a2-230a-4475-8974-1742cf873a53 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.767206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.767824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.768096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.768363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.769063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:03.769362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.770747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.785442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:03.794715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:03.915602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:03.925262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e769b-6d08-4bbd-9ad4-a5b5441eaddd None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:03.967061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:03.967712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:03.967985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:03.968253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:03.969429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:03.970896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e097d-17b1-4644-9c1e-8a0f02a6c9f5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:03.972836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:03.982734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.122790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:04.175261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418c9-6610-4bc6-b5bb-88703c3b4cce None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.236677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.237691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.238158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.238637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.337289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:04.338887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:04.467047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32400-cd2c-4e76-b41a-15952ff5f8df None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.467842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32400-cd2c-4e76-b41a-15952ff5f8df None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.467842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b32400-cd2c-4e76-b41a-15952ff5f8df None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.470005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 79/154] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:04.481353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.482288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.483035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.499862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:04.546388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:04.549105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:04.605061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 76/155] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:07:04.646993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:04.739575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 80/156] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:04.878680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f7d1-3621-42a6-9bba-fa60052838c7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:04.943172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:04.944045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:04.944491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:04.944773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] PATH_INFO: `/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:04.949687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] RBAC: Authorizing `identity:get_project(project_id=befe2bc3ac4043c0a0d36b1eb5fea538)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:04.951431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6738709-c02f-4e88-af99-02415de6c089 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:04.954173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 77/157] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/projects/befe2bc3ac4043c0a0d36b1eb5fea538 => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:04.961742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.126623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.135089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ea13-0cb1-4e8c-8806-09444c2fe069 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.174352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676bff7-d3f3-4a04-8ecf-4440d1108cb6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.174693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676bff7-d3f3-4a04-8ecf-4440d1108cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.174901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676bff7-d3f3-4a04-8ecf-4440d1108cb6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.176250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 78/158] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:05.182145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53c56-9197-4f06-bba7-e4881712449a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.182435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53c56-9197-4f06-bba7-e4881712449a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.182761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53c56-9197-4f06-bba7-e4881712449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.190394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.191100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.191376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.191857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.193677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=befe2bc3ac4043c0a0d36b1eb5fea538, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:05.193998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:05.195603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78283409-b16c-42e2-b8d3-7277f2414afb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:05.213963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-83c53c56-9197-4f06-bba7-e4881712449a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:05.214810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 81/159] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:04 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=befe2bc3ac4043c0a0d36b1eb5fea538&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:05.215191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-83c53c56-9197-4f06-bba7-e4881712449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:05.276290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.322188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 79/160] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:05.365160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659813a9-394e-4c2a-84e5-dcf80b900210 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.365511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659813a9-394e-4c2a-84e5-dcf80b900210 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.365699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659813a9-394e-4c2a-84e5-dcf80b900210 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.367280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 82/161] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:05.378253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b9919-01bf-432d-abd6-2510c578648c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.378438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b9919-01bf-432d-abd6-2510c578648c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.378710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b9919-01bf-432d-abd6-2510c578648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.407050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-569b9919-01bf-432d-abd6-2510c578648c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:05.408253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-569b9919-01bf-432d-abd6-2510c578648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:05.496598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:05.600719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659813a9-394e-4c2a-84e5-dcf80b900210 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.752496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659813a9-394e-4c2a-84e5-dcf80b900210 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:05.795923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:05.796984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:05.797571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:05.798164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:05.812692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:05.823700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:05.824686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:05.825707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:05.828158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:05.837710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b9919-01bf-432d-abd6-2510c578648c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.982490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:05.986223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:05.988422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b9919-01bf-432d-abd6-2510c578648c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.026097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.048567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.049209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.049489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.049761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.050942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:06.051250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.052954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794fb21-78b7-4f7b-9eaa-199500691d99 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.064839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 81/164] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.067109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901ea-a21e-455f-92be-97f14ba57c44 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.067426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901ea-a21e-455f-92be-97f14ba57c44 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.067702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901ea-a21e-455f-92be-97f14ba57c44 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.069182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 82/165] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.070067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9901ea-a21e-455f-92be-97f14ba57c44 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.183247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58b44-0b5a-4898-beec-97afcbe4f6a0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.225086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.225726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.225997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.226262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.238162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-bd248f72-5ca7-4be1-a8b8-358af7e3ff00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:06.243786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:06.244943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:06.245752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 84/166] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:06.246657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9901ea-a21e-455f-92be-97f14ba57c44 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.246728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.246728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.246853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.268506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:06.269781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:06.287478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.288186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.288609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.288976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] PATH_INFO: `/v3/users/f8200bcf27da433fa27fff3a3ac11f6b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.290198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200bcf27da433fa27fff3a3ac11f6b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.291878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ecd1-90fc-4e41-991d-47d9779b2e18 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.294162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/users/f8200bcf27da433fa27fff3a3ac11f6b => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.295415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e61e-d78d-46ba-a8ab-ce0f06d14bbd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.295694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e61e-d78d-46ba-a8ab-ce0f06d14bbd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.296061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e61e-d78d-46ba-a8ab-ce0f06d14bbd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.297697 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 84/168] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.298299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9e61e-d78d-46ba-a8ab-ce0f06d14bbd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.335382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.347096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 85/169] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:06.348036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.365735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.459907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9e61e-d78d-46ba-a8ab-ce0f06d14bbd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.495147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b901-16af-46f8-850e-0c5ff23b106f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.501846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.502526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.502807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.503079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.516266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-568963e5-d642-454f-81b4-56979bdb0193 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:06.521696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:06.522825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 85/170] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:06.528958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664aeb3-04e4-4add-b86f-7b4b4376ccb1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.529673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664aeb3-04e4-4add-b86f-7b4b4376ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.529673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664aeb3-04e4-4add-b86f-7b4b4376ccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.542759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.543333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.543604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.543870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.544611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:06.545012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.546149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d664aeb3-04e4-4add-b86f-7b4b4376ccb1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:06.546557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.547436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d664aeb3-04e4-4add-b86f-7b4b4376ccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:06.557132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.557793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.632818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 86/172] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:06.634949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed31c-704b-4297-8771-4352563172e0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.635453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed31c-704b-4297-8771-4352563172e0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.635942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eed31c-704b-4297-8771-4352563172e0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.638132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 87/173] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.639263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f96-8c78-4471-89af-66055d727ce4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.639597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f96-8c78-4471-89af-66055d727ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.639799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98f96-8c78-4471-89af-66055d727ce4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.641159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 88/174] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:06.645400 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98f96-8c78-4471-89af-66055d727ce4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.664839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.673260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.719486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d538-e2c5-4dad-9cf8-c9835bce9c1a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.764829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98f96-8c78-4471-89af-66055d727ce4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:06.778108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.778764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.779036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.779302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.819211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:06.820096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:06.820604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:06.821036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:06.822986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:06.822986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.824947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.840483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 89/175] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:06.843281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:06.876253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:06.878101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:06.952738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.959299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.975383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e843-2a3c-4398-9d22-19aa1d138729 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.003306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 87/176] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:07.004168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.017493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.018306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.018588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.018863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.020344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.021912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523a89b-bb7d-41e3-bbfe-405c63918561 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.023527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 90/177] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:06 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.025339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17be6b-205b-4167-8f6d-4abb8d7eb902 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.025706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17be6b-205b-4167-8f6d-4abb8d7eb902 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.025989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17be6b-205b-4167-8f6d-4abb8d7eb902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.048226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ea17be6b-205b-4167-8f6d-4abb8d7eb902 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:07.049476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ea17be6b-205b-4167-8f6d-4abb8d7eb902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:07.136508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:07.136692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a298a1-09b4-4cc6-9e25-c58bf2c2dc80 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.136800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.136800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.136800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.144442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:07.145999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:07.159566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.160218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.160520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.160781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.174612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:07.179619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:07.180814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:07.183069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 88/179] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:07.186883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.223146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.244765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:07.244765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.257280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.333534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f503-fbaa-496b-a220-d2ee68b13385 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.375641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.376450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.376827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.377192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] PATH_INFO: `/v3/users/ab915a38b89e4af49060b218b2868091` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.378459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] RBAC: Authorizing `identity:get_user(user_id=ab915a38b89e4af49060b218b2868091)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.380531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.381873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 89/181] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/users/ab915a38b89e4af49060b218b2868091 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.382741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.398652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ac1dc-6b88-4e4c-9ebd-e988c005514f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.445743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.446425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.446975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.447544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.462586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:07.467916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:07.469004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:07.469847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:07.470492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 93/182] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:07.471136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.518250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.524329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee9aa5-3184-40c8-8622-fa197c13d388 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.561108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.584316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.584876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.585210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.585486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.586641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.588560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.590255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 90/183] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.593289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.594230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6d5fe-8baf-4140-b30d-6eef81514e1a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.631945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.632589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.632863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.633125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.710622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3633-3b02-433f-a02c-1571b2a7433a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.731020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.732700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.752683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.753293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.753564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.753813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.754491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:07.754787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.756225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.765906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 91/184] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.766956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.801753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.819521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:07.858511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:07.859379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.899034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3722058-f285-4851-8e63-ae842b300413 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:07.936693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:07.937333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:07.937607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:07.937874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:07.939093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:07.940609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:07.944586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 92/186] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:07.944586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:07.987025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aaa0f-8368-41b1-8ec0-e5fb3ae11409 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.030002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.030620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.030896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.031161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.063285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.069689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c813d4-d0d2-44f3-9f94-ff7d861ff5e3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.086628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.119996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.120896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.120896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.121127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.121727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:08.122021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.123428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.124084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.126640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.132215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 93/187] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.133081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.249617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 95/188] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:08.251253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.266587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c0a0-9d5d-48de-b22c-aea6da320bd1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.312780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.313847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.314313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.314779 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.332120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:08.337734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:08.340689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:08.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 94/189] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:08.345776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.356333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.371199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.400367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e180705-0623-4010-9e31-aa5d87546cdd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.439211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.439827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.440108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.440376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.441144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=f8200bcf27da433fa27fff3a3ac11f6b) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:08.441452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.442941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.449771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/role_assignments?user.id=f8200bcf27da433fa27fff3a3ac11f6b&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.457598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.483086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44830b1a-7c72-4420-9b9d-c18ade276cfa None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.534348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.535298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.535746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.536187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.562746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.564344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.566358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.574178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.645712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bd2f9-f4f7-4cc5-a4a9-880981928da8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.706864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.707891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.708297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.708687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.710559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.714268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.717196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.718790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.722563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.735383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:08.767574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc73a9b-d763-4cfe-8676-9e42eff8ec96 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.817805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.818734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.819138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.819560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.822820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.823552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.853360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 96/193] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:08 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:08.854981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:08.891704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d2afe-f2c2-42e1-810e-5c98be5c043a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:08.949716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:08.950480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:08.950858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:08.951264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:08.952607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:08.954121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:08.956052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 98/194] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:08.956682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.028917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe6cb-25f2-412d-a75d-983c116c4f2b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.077593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.081267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.086674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.087890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.088364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.088807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.093370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.095525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.098371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 97/195] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:09.099691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.122067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfff26-54e5-4862-90b0-2869492bd33c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.181542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.182889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.183601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.183937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.184911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:09.185412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.187307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.205424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 99/196] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:09.206903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.288681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ba80-ca3b-4716-ae1d-dae1f7d60fea None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.345413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.346179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.346457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.346778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.371058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acce980-1bbc-4773-ae44-c1ca5e41f8d0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.412683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.419547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.420176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.420477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.420747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.421483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:09.421790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.423973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.432524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 100/197] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:09.433472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.466593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.472082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.473645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.621582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d236-1097-449c-95f1-c221b812b77e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:09.709906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:09.711841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:09.712343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:09.712889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:09.753787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 98/198] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:09.756523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:09.840026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.855203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:09.858294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:09.966269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:09.973507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670b8e8-17fe-4c1c-b4a8-bb0236aa3551 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.042405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.044007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.044820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.045374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 101/199] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:10.046550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.046839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.048562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=ab915a38b89e4af49060b218b2868091) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:10.049605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.052753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.066114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 99/200] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:09 2022] GET /identity/v3/role_assignments?user.id=ab915a38b89e4af49060b218b2868091&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=acda13de619a41d5b6fafe2f998424fb => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.068037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.240723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:10.251819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc1ba-1137-4164-8f29-99df1185a61e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.278912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789c7c-a832-4adb-8870-d6d36d5b0db3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.320493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.320493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.320493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.320493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] PATH_INFO: `/v3/users/91d34538760547ffa0705c97a3ad545d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.321112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] RBAC: Authorizing `identity:get_user(user_id=91d34538760547ffa0705c97a3ad545d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.323485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.326460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 102/201] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/users/91d34538760547ffa0705c97a3ad545d => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.327821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.395578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.397479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.398237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.399058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.402332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.408783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.412831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 100/202] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.415013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.480366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:10.537999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5ca5-1f28-43a7-b718-51703d5a45b0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.599102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.599759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.600035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.600303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.601810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.603790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.606180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.607535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.627348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec565-d83e-43dc-99ae-9e8b22c05597 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.667868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.668545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.668822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.669090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.679322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:10.762754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.764325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.805820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cee212-4e8a-445a-992c-e2ff3e554fca None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:10.823444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:10.854614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:10.855318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:10.855598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:10.855951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:10.856768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=fca392808db849369e5c2da050a2de39) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:10.857079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:10.859094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:10.866197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 104/204] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/role_assignments?user.id=fca392808db849369e5c2da050a2de39&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:10.867139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:10.988493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 101/205] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:11.001796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.079170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0161c-0251-40ec-b296-cb93b3c5e757 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.092896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.121117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.121845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.122166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.122443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.123181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=fca392808db849369e5c2da050a2de39) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:11.123491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:11.125004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:11.131978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 105/206] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:10 2022] GET /identity/v3/role_assignments?user.id=fca392808db849369e5c2da050a2de39&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=acda13de619a41d5b6fafe2f998424fb => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:11.160929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f2888-843e-46e5-9cd1-881adf1ebde0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.201675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.208819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.209887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.210366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.210783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.212332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:11.214940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a7094-4db5-4217-8f4d-91d9f9761be9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:11.217140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 102/207] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:11.224456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.247995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d874-556e-4ccc-92e2-8826e014c51a None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.248557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d874-556e-4ccc-92e2-8826e014c51a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.249063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d874-556e-4ccc-92e2-8826e014c51a None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.250581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 103/208] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:11.256340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf11d-555a-43e7-97c7-80a9526bf78d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.256899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf11d-555a-43e7-97c7-80a9526bf78d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.257370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bf11d-555a-43e7-97c7-80a9526bf78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.302931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c14bf11d-555a-43e7-97c7-80a9526bf78d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:11.304686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c14bf11d-555a-43e7-97c7-80a9526bf78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:11.360643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dbd6-7d17-4fb8-bf82-218f077b63eb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:11.409043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:11.409427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.409657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.409900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.410642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, scope.project.id=70fda73f798844989b6b114060b75adb, user.id=91d34538760547ffa0705c97a3ad545d) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:11.410952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:11.417304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ea548-bd0a-4844-9dac-bb702ae41f50 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:11.433006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 106/209] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/role_assignments?user.id=91d34538760547ffa0705c97a3ad545d&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:11.450534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 104/210] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:11.544427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7012-77ac-4fbe-b899-3eb5bbe9cc0b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.544782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7012-77ac-4fbe-b899-3eb5bbe9cc0b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.544993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7012-77ac-4fbe-b899-3eb5bbe9cc0b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.546552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 107/211] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:11.552439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:11.553065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:11.553554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:11.585979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:11.587683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:11.698040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:11.840719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7012-77ac-4fbe-b899-3eb5bbe9cc0b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:11.882278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:11.992843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7012-77ac-4fbe-b899-3eb5bbe9cc0b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.035064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.035707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.035982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.036299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:12.058783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:12.059742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:12.061003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:12.061612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.062000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 108/213] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:12.077230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.169998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.210197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.232561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e6fe7-9a97-4165-84a3-6f776221ba83 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.239227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a6696-3d1f-4a10-bd47-07850605a53b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.283682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.284646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.285066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.285471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.286201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.286514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:12.286977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.287518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.287986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.288494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.289398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.290253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.292550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.294608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 106/214] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:12.302621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.302891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 109/215] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:12.310643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.462136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3143e12-cf43-4d55-ace3-a559e53520fc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.462905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e4d0-b4c9-4ab7-8163-eb1865966fce None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.493758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.505092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.506090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.506465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.506832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.507721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.509328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.512352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.513135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.513415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.513696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] PATH_INFO: `/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.537437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] RBAC: Authorizing `identity:get_user(user_id=4a25d56c09f243f4bf967ae3b36d3eb0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.538658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 107/216] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:12 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:12.539736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.542654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:12.552485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:12.688823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8eb73d-da91-4bbb-a0ba-4530f53df98f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:12.732483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:12.733376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:12.733793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:12.734198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:12.793662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:12.813373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:12.815793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:12.987227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 108/218] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:12.994967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.004214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.149104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ed5-0cf2-42d0-b5ab-b490d5aaaa61 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.215095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.216057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.216057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.216278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.217753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.219231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049adc26-a734-483b-af69-fa27c1aac063 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.221245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 111/219] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:12 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:13.230974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:13.377643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.396121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b60e9-4ce8-44bc-93ad-16394bf18610 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:13.437259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:13.437796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.438073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.438345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.439123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=4a25d56c09f243f4bf967ae3b36d3eb0) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:13.439432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:13.441087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71dbcb-e79a-46fa-8f23-61c536e7e780 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:13.448703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 109/220] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:13 2022] GET /identity/v3/role_assignments?user.id=4a25d56c09f243f4bf967ae3b36d3eb0&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:13.490534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ae5a-de7f-4fde-97cc-ede09c350598 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.490899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ae5a-de7f-4fde-97cc-ede09c350598 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.491164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ae5a-de7f-4fde-97cc-ede09c350598 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.492614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 112/221] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:13.499126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.499798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.500270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.531145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:13.532851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:13.567751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fd45-eae2-4ee1-85af-1e119161d954 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.568098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fd45-eae2-4ee1-85af-1e119161d954 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.568304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fd45-eae2-4ee1-85af-1e119161d954 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.570065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 113/222] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:13.576027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.576334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.576612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.599638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:13.601011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:13.655108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:13.732121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:14.006716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.147178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.178552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656707-1e4b-4a8c-a63f-760b72180cce None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.228968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.230276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.230859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.231453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.243752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.247179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.256285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:14.267922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:14.269520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:14.270801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:14.274288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 111/225] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:14.283254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.449049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0629d-081c-441c-bfaf-450d1aea0918 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.505482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.506924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.507689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.508439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.531024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:14.542339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:14.544055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:14.545638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:14.550599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 115/226] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:14.563035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.580001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de855-4ffe-4dee-bed3-7113bfd8d69d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.690146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.690861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.691160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.691403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.692105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:14.692424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:14.693865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:14.706102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.712305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 112/227] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:14.726406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.750601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.837555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b3-f04e-49b5-bcfa-abcfcec87225 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.937278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.937932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.938193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9d8a-9da7-46b1-85b5-707a3e4b9368 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:14.938334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.938546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.939188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:14.939494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:14.941039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:14.966306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 116/228] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:14.967593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:14.993401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:14.996176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.996635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.997627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.999950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.003533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.011075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 113/229] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:15.019797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.176257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdff89-95b7-40ca-8f55-b48d5af446e9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.199753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:15.232225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:15.255610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.256784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.257348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.257687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.258959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b8ce8-341c-4cb1-86a1-7f405e91eeda None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.259656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.260610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d4992-3b83-4a85-a87a-c92696772763 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.264177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 117/230] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:14 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:15.265553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1bcc2-e915-40e4-8fce-53e8b5aa5a04 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.265836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1bcc2-e915-40e4-8fce-53e8b5aa5a04 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.266111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1bcc2-e915-40e4-8fce-53e8b5aa5a04 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.267548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 118/231] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:15.272704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1bcc2-e915-40e4-8fce-53e8b5aa5a04 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.311325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.312248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.312563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.313089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.314984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.316515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddfd4c-e7b5-4e4b-bb37-6127b92b2966 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.318845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 114/232] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:15 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:15.321170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88076-a188-4381-91b4-518f873e7727 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.321552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88076-a188-4381-91b4-518f873e7727 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.321791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff88076-a188-4381-91b4-518f873e7727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.342244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-fff88076-a188-4381-91b4-518f873e7727 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:15.343461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fff88076-a188-4381-91b4-518f873e7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:15.416675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1bcc2-e915-40e4-8fce-53e8b5aa5a04 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.440757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 115/233] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:15.441657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88076-a188-4381-91b4-518f873e7727 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.486381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.487149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.487433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.487754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.489062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.490683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.493193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 119/234] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:15 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:15.498813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.520514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:15.569031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff88076-a188-4381-91b4-518f873e7727 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.600774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:15.619925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.620959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.621407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.621831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/fca392808db849369e5c2da050a2de39/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.625210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, user_id=fca392808db849369e5c2da050a2de39, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.627482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072db4-7aac-4e3e-8080-92163b419b04 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.646509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:15 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/fca392808db849369e5c2da050a2de39/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:15.648990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d866d-ac69-43cd-96e6-e4042584cc36 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.650206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d866d-ac69-43cd-96e6-e4042584cc36 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.651179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d866d-ac69-43cd-96e6-e4042584cc36 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.653552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 117/236] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:15.654147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdaa93-ac29-4192-aac0-f9c60626e231 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:15.668856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.669188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.669402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.717376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:15.718855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:15.748319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:15.750109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:15.750389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:15.752451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/fca392808db849369e5c2da050a2de39/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:15.756134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, user_id=fca392808db849369e5c2da050a2de39, role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:15.759317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:15.785864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 120/237] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:15 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/fca392808db849369e5c2da050a2de39/roles/acda13de619a41d5b6fafe2f998424fb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:15.786888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:15.884544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 118/238] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:16.012274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55200f6-a99a-4be1-93bc-3f4371cb20f3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.042311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.070724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.074143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.075404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.075835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.077222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.078816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d1c9f-a904-4860-979a-5ad9e18884fe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.080749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 121/239] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:16.088275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.123046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51e6d-8c83-4c6b-a77a-c36497d268d1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.123449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51e6d-8c83-4c6b-a77a-c36497d268d1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.123582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb51e6d-8c83-4c6b-a77a-c36497d268d1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.125122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 122/240] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:16.134782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.135239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.135841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.164112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:16.165923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:16.168415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.222011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd3d2-e3ce-4f55-8206-12c6efd68bc7 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.256420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 123/241] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:16.257926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.286369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.288117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.289192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.289828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.292156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.293901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.338050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 119/242] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:16 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:07:16.457434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2147-57a0-4452-9b65-5d57d024e94b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.486823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.510563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.511147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.511421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.511689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.530059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:16.536046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:16.537741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:16.538862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 124/243] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:16.546513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.689471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.691599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41a32-34f6-4774-a1db-50129c3e6860 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.708602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:16.740478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.741114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.741391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.741682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.742973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:16.743289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.745459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.760699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 120/244] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:16.768318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.888778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f1e3-53d2-430d-98fb-15f2b3db5ef6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.905202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b6c4-331b-4a45-b594-597f6986a34e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:16.946023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.946676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.947077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.947530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] PATH_INFO: `/v3/users/562e31a947eb44e89b4cfa861f46290a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.966737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] RBAC: Authorizing `identity:get_user(user_id=562e31a947eb44e89b4cfa861f46290a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:16.968335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:16.970133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 121/245] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/users/562e31a947eb44e89b4cfa861f46290a => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:16.972556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:16.973790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:16.974489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:16.975274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:16.976300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:16.999704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:17.005835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:17.007507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:17.009075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 125/246] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:17.031232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.050480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.126753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c950-8a59-453d-9c0c-f774a226bd37 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.142265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.181462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.182777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.183287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.183775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.238348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d6091-0a68-4bda-811e-bc721733713a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.271121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.273082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.280024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.280779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.281001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.281330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.281959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:17.282261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.283848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.295006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 126/247] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:17.301167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.315511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.411809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 122/248] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:07:17.422169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.425638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.442579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda1a6e-8e28-4b69-a3fe-928de37b824d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.564490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.565974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.566765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.567518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] PATH_INFO: `/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.574081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] RBAC: Authorizing `identity:get_user(user_id=4a25d56c09f243f4bf967ae3b36d3eb0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.577212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.583914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 127/249] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:17.591504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.765082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6de6c-b451-47f0-ae09-82641a46ad32 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:17.827683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.852538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:17.853279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.853559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.853826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.856743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:17.858246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:17.860548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 123/250] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:17.867389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:17.939923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb193c5-b655-41d0-a9d1-eb05d631bb69 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.021173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cc808-fc8c-49d9-bedb-9e107889d83e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.065619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.068044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.068345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.068658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.069429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=562e31a947eb44e89b4cfa861f46290a) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:18.069751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.071371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.078142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.078700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.078986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.079262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.081639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.083145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff2350-14f9-4945-ad94-6015a8fb4f95 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.089381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/role_assignments?user.id=562e31a947eb44e89b4cfa861f46290a&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:18.089620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 128/252] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:17 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:18.102406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:18.225087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:18.301175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0f93-f1f5-4664-bd1a-ee9b6ba083e6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.348021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.349066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.349066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.349498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/4a25d56c09f243f4bf967ae3b36d3eb0/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.351406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, user_id=4a25d56c09f243f4bf967ae3b36d3eb0, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.352910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bb944-2d8c-4182-be21-4e7e1c01b9ea None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.371543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:18 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/4a25d56c09f243f4bf967ae3b36d3eb0/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:19.178814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1395-9d2a-47a7-87c3-ff61c17cd1e1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.179330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1395-9d2a-47a7-87c3-ff61c17cd1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.179330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1395-9d2a-47a7-87c3-ff61c17cd1e1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.180998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 129/254] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:19.187673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.187673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.187673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.204092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3563-162f-413b-8622-43a7dc36170e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.204425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3563-162f-413b-8622-43a7dc36170e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.204673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f3563-162f-413b-8622-43a7dc36170e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.206642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 130/255] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:19.213688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.214022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.214226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.229137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:19.230524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:19.271747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:19.272999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:19.327758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:19.431071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 131/256] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:19.441769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 126/257] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:19.983279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.083651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.209304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51fc5-50b5-49aa-bb7a-856a9f446af3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.234166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.266135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.267224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.267629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.268070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.288508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:20.294901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:20.296042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:20.300460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:20.302942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 132/258] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:20.309465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.340060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183b7d7-321f-43d5-869a-57669ae63430 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.357016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.418453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.419246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.419612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.419952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.444328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:20.458776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:20.459768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:20.460792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 127/259] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:20.473646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395c75-1618-44f3-a30e-92559c27d17b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.480935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.537417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.538539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.543930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.544735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.546025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:20.546791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.550088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb13a6-1ddb-4928-aecb-2b5845714b37 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.581873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 133/260] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:20.584698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0be03-baee-40e9-a736-f26229aaeb48 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.585130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0be03-baee-40e9-a736-f26229aaeb48 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.585617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0be03-baee-40e9-a736-f26229aaeb48 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.591243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 134/261] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:20.598066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0be03-baee-40e9-a736-f26229aaeb48 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.771931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.799588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0be03-baee-40e9-a736-f26229aaeb48 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.819838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820cfc-5352-4764-befa-84a42caa2400 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.870109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.871560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.872115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.872695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.875093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.878663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c477c94-da9b-4ba3-84df-0171de91413e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.879525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.882637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:20.885123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7fca8-249b-427d-b854-869ce78608d4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.885682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7fca8-249b-427d-b854-869ce78608d4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.888422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7fca8-249b-427d-b854-869ce78608d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.920482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cfa7fca8-249b-427d-b854-869ce78608d4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:20.920482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cfa7fca8-249b-427d-b854-869ce78608d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:20.946178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.947669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.948423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.949096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.951252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:20.952386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.955427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.975451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 128/263] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:20.977387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.045908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 136/264] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:21.047619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f803-d899-4757-b79c-70495c8f812d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.047790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f803-d899-4757-b79c-70495c8f812d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.047917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f803-d899-4757-b79c-70495c8f812d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.049262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 137/265] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:21.054125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f803-d899-4757-b79c-70495c8f812d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.198748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a823d-4806-449d-9d88-e021d6eba068 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.227721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.252371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f803-d899-4757-b79c-70495c8f812d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.293057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.294078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.294676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.295262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.298155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.299252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.299676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.300891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] PATH_INFO: `/v3/users/fca392808db849369e5c2da050a2de39` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.305236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] RBAC: Authorizing `identity:get_user(user_id=fca392808db849369e5c2da050a2de39)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:21.308002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9e24-0432-4a99-a166-0a202e0f1cce None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:21.311341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 138/266] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/users/fca392808db849369e5c2da050a2de39 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:21.313354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa9e8-d635-4534-872a-198814a9da35 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.314123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa9e8-d635-4534-872a-198814a9da35 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.314647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa9e8-d635-4534-872a-198814a9da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.342330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a86fa9e8-d635-4534-872a-198814a9da35 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:21.345026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a86fa9e8-d635-4534-872a-198814a9da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:21.352302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.377503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:21.379626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 139/267] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c57d9-6768-4edb-8aab-0f22dfd84aff None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c57d9-6768-4edb-8aab-0f22dfd84aff None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c57d9-6768-4edb-8aab-0f22dfd84aff None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 140/268] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:21.460424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c57d9-6768-4edb-8aab-0f22dfd84aff None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.528548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 129/269] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:21.530070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.577820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.599099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c57d9-6768-4edb-8aab-0f22dfd84aff None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.648521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.649234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.650523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.651213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.652079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.679814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79075d25-d9a4-4d6a-a214-c132b49aa900 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:21.723315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:21.724351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.724829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.725268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.726686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:21.729090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a3fc7-6548-4af8-9988-5be1d256f369 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:21.731476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 130/270] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:21.732984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.733455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.733945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.755840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:21.756057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:21.757446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:21.757788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:21.843614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:21.844797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.862259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.886181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 141/272] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:21.887377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:21.968418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.012683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c5ab9-1029-4ce9-8d74-9a0c2537b156 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.014769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032676c-8f9f-42a3-9da1-cb1cbff0813e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.057909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.057909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.057909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.058721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.059330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.060840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.061050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.061773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.062113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.067684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.067826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 132/273] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:21 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.067913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.067995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.068079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.096239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 142/274] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:21 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:22.097565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.165677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.214907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eb203-62db-463e-a407-7b8272e1037c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.263055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9188ebd-9c78-4d08-a718-b2d8a7378392 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.268489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.268489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.268489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.268489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.284500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-fd3034ce-819f-4a27-ae40-df8f0017ac19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:22.290347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:22.292871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 133/275] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:22.294179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eed0d-4668-4366-bd20-4b5ca82a0ca2 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.294991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eed0d-4668-4366-bd20-4b5ca82a0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.294991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eed0d-4668-4366-bd20-4b5ca82a0ca2 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.295673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 134/276] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:22.296349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eed0d-4668-4366-bd20-4b5ca82a0ca2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.301609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.317288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.318215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.318621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.319211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.320731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.323823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.326447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 143/277] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.327619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.451247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eed0d-4668-4366-bd20-4b5ca82a0ca2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.491392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8af9-76d3-406e-8586-62bf42156509 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.502648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.502956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.503689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.503905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.504221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.505260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=fca392808db849369e5c2da050a2de39) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:22.505570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.507063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.514706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 135/278] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/role_assignments?user.id=fca392808db849369e5c2da050a2de39&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=acda13de619a41d5b6fafe2f998424fb => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.515595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.542810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.543885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.544434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.544896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.559483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d64b77d9-62db-4877-bd8a-684952f07d2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:22.565877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:22.566862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:22.567695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:22.570565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 144/279] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:22.572684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.573619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.574373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.598373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:22.600487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:22.617697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.666763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d69480-c36d-4c31-b679-47200b24c28e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.692962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:22.694319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.709587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.710228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.710503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.710767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.711461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:22.711760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.713579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.723760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 136/281] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.724585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.820820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.825413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221c120-d079-4d41-9658-c8cd76f93ed6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.871929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.872947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.873361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.873765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.875529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=fca392808db849369e5c2da050a2de39) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:22.876097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.877953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.887072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 146/282] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/role_assignments?user.id=fca392808db849369e5c2da050a2de39&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:22.888377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.944145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45352d16-9138-4dd7-ac54-77f11dc5da87 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.036166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204e41d-f474-4ed1-a870-05aea794ad8c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.056975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.072910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.073551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.073833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.074105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.074877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:23.075187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.080190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.090356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.091086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.091375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.091651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] PATH_INFO: `/v3/users/cc209ed94237430ab09e29c749b4e1e7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.099336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 137/283] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.100277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.117248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] RBAC: Authorizing `identity:get_user(user_id=cc209ed94237430ab09e29c749b4e1e7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.118777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.121241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 147/284] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/users/cc209ed94237430ab09e29c749b4e1e7 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.121946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.151987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.264121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b86458-2703-4ce3-bbb7-a4e1c2529310 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.310994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2794c38-bb24-41e3-8fa5-bfd87114c41a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.324631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.325364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.325648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.325919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] PATH_INFO: `/v3/users/562e31a947eb44e89b4cfa861f46290a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.327165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] RBAC: Authorizing `identity:get_user(user_id=562e31a947eb44e89b4cfa861f46290a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.328846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.331770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 138/285] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/users/562e31a947eb44e89b4cfa861f46290a => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.332653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.392536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.394046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.394784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.395553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.415723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:23.424869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:23.426457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:23.428365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:23.429899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:23.442133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 148/286] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:23.444161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.484992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720b99-4879-40a4-9f1b-1e411ca99e46 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.540533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.540533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.540533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.540533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.542417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, user.id=cc209ed94237430ab09e29c749b4e1e7, scope.system=all) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:23.543185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.545490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.552091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 139/287] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/role_assignments?user.id=cc209ed94237430ab09e29c749b4e1e7&scope.system=all&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.553003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.632434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.694588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b45cf-1825-46e5-933f-de2211d9ca57 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.712537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7415a3-f615-4e21-9c3f-0103ab30e9ff None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:23.755015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.768142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.769237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.769727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.770219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.771698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.774127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.782508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:23.782508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.782508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.782508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.783058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:23.783058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:23.783058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:23.784010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 149/288] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.786345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:23.799258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 140/289] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:23.805514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.038140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ba-aaee-43da-9172-60b00b4683ee None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.053847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cf4e6-fea8-4f61-a1fd-d0dcf2c0a55b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.112986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.114047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.114527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.114986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] PATH_INFO: `/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.116776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] RBAC: Authorizing `identity:get_user(user_id=4a25d56c09f243f4bf967ae3b36d3eb0)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.119406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.122581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 141/290] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:23 2022] GET /identity/v3/users/4a25d56c09f243f4bf967ae3b36d3eb0 => generated 297 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.123543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.124470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.124973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.125445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/562e31a947eb44e89b4cfa861f46290a/roles/39507246e6dd42d2ace529471fbe1b2a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.127527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.129690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, user_id=562e31a947eb44e89b4cfa861f46290a, role_id=39507246e6dd42d2ace529471fbe1b2a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.133718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.163680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 150/291] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:07:23 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/users/562e31a947eb44e89b4cfa861f46290a/roles/39507246e6dd42d2ace529471fbe1b2a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:24.237794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.313540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066f5f7-c174-4acb-bdfa-8cd93c74770d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.371951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.372663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.373098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.373505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.478211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.480538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.574340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.648338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 142/292] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:24.657011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.671007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.834671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9603-0703-4bfa-bf3c-4ba68302f095 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.889592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.890280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.890555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.890996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.892915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.894910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c3c7-45e7-4622-b717-47ab4fe7f353 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.897028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 151/293] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:24.904311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.089547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a994b-834d-404f-b561-e1208438b7f9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.089848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a994b-834d-404f-b561-e1208438b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.090009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a994b-834d-404f-b561-e1208438b7f9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.091385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 152/294] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:25.096940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.097215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.097479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.119543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:25.120786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:25.124423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92129a-e7d8-410d-b50e-67859410a573 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.171075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.171949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.172228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.172530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.173422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=4a25d56c09f243f4bf967ae3b36d3eb0) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:25.173878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.175432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280f9e4-6eae-4b8f-80f9-c36473d2cd89 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.192422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 143/295] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/role_assignments?user.id=4a25d56c09f243f4bf967ae3b36d3eb0&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:25.192422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc5b35-2447-4a0e-97e7-116c6974c82d None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.192422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc5b35-2447-4a0e-97e7-116c6974c82d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.192422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc5b35-2447-4a0e-97e7-116c6974c82d None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.192422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 144/296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:25.204614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.204614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.204614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.222169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:25.223898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:25.239358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.239681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 153/297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:25.333031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 145/298] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:25.593277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.602612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.678099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.747432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfff5cf-e80d-4cc4-ae0f-bce7c8c48237 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.802741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.803269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.803521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.803945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.807339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:25.807339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:25.810126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 154/299] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:25.816887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.837571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d1376-300d-4cdd-8a9a-65e652d3b209 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:25.889611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:25.890167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.890439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.890700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.904753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:25.910400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:25.911374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:25.912892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 146/300] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:25.921899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:25.933174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.938084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:25.966875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256d750-0e81-44ba-b920-96b1ba953ded None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.008116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.008994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.009368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.009901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] PATH_INFO: `/v3/groups` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.010888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.013207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.041859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 155/301] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Aug 29 20:07:25 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:26.092705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5d89-3c7f-46d9-a90c-c8aee59a0b85 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.135719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.136448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.136726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.136991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.137676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:26.137972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.139386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dae9a9-b850-4194-9d99-103d23355d2e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.149482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 147/302] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.158145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.187753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a89-5bce-4775-9a7e-d51349c599b9 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.188443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a89-5bce-4775-9a7e-d51349c599b9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.188728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3a89-5bce-4775-9a7e-d51349c599b9 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.190623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 148/303] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:26.197516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.197828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.198171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.222277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:26.223601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:26.310661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a923-85e7-4ddf-90e9-6843cdb9e494 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.322689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.329706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 149/304] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:26.366441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.367524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.368044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.368575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] PATH_INFO: `/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.375094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.391588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] RBAC: Authorizing `identity:get_user(user_id=49231714cf1c4be9a1fbfd9e7fffeee3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.394742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.398905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 156/305] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3 => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:26.405081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.558737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a05e-0c8f-4b41-8301-295c272fe572 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.616620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.617240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.617516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.617778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.618526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, user.id=49231714cf1c4be9a1fbfd9e7fffeee3, scope.system=all) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:26.618929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.620617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.632580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 150/306] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/role_assignments?user.id=49231714cf1c4be9a1fbfd9e7fffeee3&scope.system=all&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:26.660510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.826065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc3a7-8210-43e1-b1e4-43b360b46be2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.867447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.868106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.868383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.868680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.880630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-30438dc9-c418-4a4c-99c2-b58cbbc4bdb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:26.885848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:26.886787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:26.887584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 157/307] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:26.892948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.966854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687d65-b47f-48b7-a23f-2b5582d2dcb9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.967174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687d65-b47f-48b7-a23f-2b5582d2dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.967302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c687d65-b47f-48b7-a23f-2b5582d2dcb9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.968691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 158/308] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:26.975074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.984428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.984428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.984428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.012770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:27.014994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:27.023274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35a91-6fb7-4fc6-8c4e-c6d195331798 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.069170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.070214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.070490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.070760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.071460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:27.071760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:27.073720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:27.086515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 151/309] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:27.092841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.106578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:27.145089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 159/310] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:27.219502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb501f7-261c-43c8-a384-93a0c25c196b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.252967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:27.268223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.268912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.269188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.269458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] PATH_INFO: `/v3/users/cc209ed94237430ab09e29c749b4e1e7` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.270712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] RBAC: Authorizing `identity:get_user(user_id=cc209ed94237430ab09e29c749b4e1e7)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:27.272189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:27.274176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 152/311] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:27 2022] GET /identity/v3/users/cc209ed94237430ab09e29c749b4e1e7 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:27.281748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.421859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37f6f-2a7b-42de-be61-1ebfbf2d17de None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.461812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.462476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.462780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.463062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] PATH_INFO: `/v3/system/users/cc209ed94237430ab09e29c749b4e1e7/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.464486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cc209ed94237430ab09e29c749b4e1e7, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:27.465950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:27.476274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 160/312] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Aug 29 20:07:27 2022] PUT /identity/v3/system/users/cc209ed94237430ab09e29c749b4e1e7/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:27.700202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:27.889103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd809-26f5-405a-8c0c-5ed679447291 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:27.956264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:27.957359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:27.957832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:27.958293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:27.980533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:27.991182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:27.993397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:27.995438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 153/313] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:28.004581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.091374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.172200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f80a1-ff23-4c55-a50a-a424dbdf670b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.209980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.210600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.210875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.211144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.211814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:28.212113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.213702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.223546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 161/314] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.229054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.296101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.353956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65397de7-700f-44b2-95e7-e1a8676356ef None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.391857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.392529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.392803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.393067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] PATH_INFO: `/v3/users/562e31a947eb44e89b4cfa861f46290a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.394217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] RBAC: Authorizing `identity:get_user(user_id=562e31a947eb44e89b4cfa861f46290a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.395751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf068cd-6097-4f07-9985-28a70999624f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.397841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 154/315] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/users/562e31a947eb44e89b4cfa861f46290a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:28.404164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.427935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05baacb-fa9d-4ae3-a125-4f319eebe477 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.428798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05baacb-fa9d-4ae3-a125-4f319eebe477 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.429462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05baacb-fa9d-4ae3-a125-4f319eebe477 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.431934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 155/316] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:28.440379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.441207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.441966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.470548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:28.472992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:28.580251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da1c4-233f-4c33-9114-01e420f957c9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:28.594703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 156/317] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:28.597579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.634149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:28.635961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.636895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.637530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.715627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:28.717530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:28.828849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 162/318] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:28.837607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.895610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.913238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.913673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.992296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfee55-556b-446c-88df-9910e46fee85 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.040733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.040733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.041175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.041315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.043435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a49325-55ae-45a3-ad3a-963019b3d0f8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.044752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.046433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b5fb5-cb79-4e28-81df-cb6206ff2bd3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.048720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 157/319] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.050180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7400db-d29e-4f36-99e3-10f1fd057bb6 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.050441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7400db-d29e-4f36-99e3-10f1fd057bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.050834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7400db-d29e-4f36-99e3-10f1fd057bb6 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.057446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 158/320] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:29.058775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.059053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.059312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.079963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:29.081767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:29.096299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.096998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.097281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.097556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.098743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.100224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.102198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 163/321] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.102729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.172526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:29.175822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.221363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.238256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.252951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162f750-580c-48ad-b471-538c7b62634e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.295417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.296515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3872f6-2c26-4053-900f-ae10e814e3d3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.297184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.298296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.300291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.302133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2, user.id=562e31a947eb44e89b4cfa861f46290a) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:29.302952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.306052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.324982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 164/323] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/role_assignments?user.id=562e31a947eb44e89b4cfa861f46290a&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.344438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.345091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.345374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.345645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] PATH_INFO: `/v3/groups` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.346322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.347964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01c711-17e9-4546-8667-34292b970d86 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.370167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 160/324] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Aug 29 20:07:29 2022] POST /identity/v3/groups => generated 226 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:29.449218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.568724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241bb1-e114-4dcb-8d5f-8e22a91eddcb None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.569105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241bb1-e114-4dcb-8d5f-8e22a91eddcb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.569565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241bb1-e114-4dcb-8d5f-8e22a91eddcb None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.572171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 161/325] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:29.576636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b2fa1-717f-49c7-8995-8438609655d8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.579938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.580215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.580522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.605243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:29.606493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:29.630729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.631713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.632161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.632656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.644819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.650952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:29.657416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:29.658433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:29.659291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:29.663484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 165/326] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:29.664765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.717548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 162/327] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:29.819005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afedd0f-4e89-490c-86b5-c157e5723708 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.867719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.868609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.869044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.869486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.871539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:29.872079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.874283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.891545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 166/328] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:29.895993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:29.957403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.023048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.034365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b3db-092f-46aa-b486-336f157c3a6f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.088496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.089112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.089380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.089646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] PATH_INFO: `/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.090959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] RBAC: Authorizing `identity:get_user(user_id=49231714cf1c4be9a1fbfd9e7fffeee3)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.092532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.094636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 163/329] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:29 2022] GET /identity/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:30.100500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.121510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.180934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe0d6-aa23-4d30-9285-3651f3df1fbf None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.230347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.231277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.231562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.231834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.249839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:30.255831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:30.256814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:30.257780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 167/330] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:30.259012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a716b-2b9e-44cb-8d96-1d02b4f500ea None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.270851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.272598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.323884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.323884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.323884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.324283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] PATH_INFO: `/v3/system/users/49231714cf1c4be9a1fbfd9e7fffeee3/roles/39507246e6dd42d2ace529471fbe1b2a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.326772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=49231714cf1c4be9a1fbfd9e7fffeee3, role_id=39507246e6dd42d2ace529471fbe1b2a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.328207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.339487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 164/331] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Aug 29 20:07:30 2022] PUT /identity/v3/system/users/49231714cf1c4be9a1fbfd9e7fffeee3/roles/39507246e6dd42d2ace529471fbe1b2a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:30.439482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da67a1-22d0-48fa-b9f9-cc2bcecd572c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.488798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.517177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.518208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.518697 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.519194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.520201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:30.520764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.522657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.537016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 168/332] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:30.543844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.697007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a265-623a-4259-a20a-fbf7bad6b4b1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.755712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.756841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.757302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.757767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] PATH_INFO: `/v3/users/cc209ed94237430ab09e29c749b4e1e7` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.759377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] RBAC: Authorizing `identity:get_user(user_id=cc209ed94237430ab09e29c749b4e1e7)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.762428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bea943-fb04-4b64-849b-421e01fc242f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:30.765062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 165/333] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/users/cc209ed94237430ab09e29c749b4e1e7 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:30.773699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.940421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde4b04-4778-450a-96cd-54f9dcd2bb55 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:30.992617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:30.993248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.993585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.993872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.995245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] RBAC: Adding query filter params (role.id=7b370c51ccfb42a3817e8b6aca7d0483, user.id=cc209ed94237430ab09e29c749b4e1e7, scope.system=all) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:30.995245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:30.996783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b5dc8-e28d-481e-997b-223c99eda2b5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:31.021197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 169/334] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/role_assignments?user.id=cc209ed94237430ab09e29c749b4e1e7&scope.system=all&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:32.028616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c528-1808-4ace-886d-bf25790cb380 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.029629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c528-1808-4ace-886d-bf25790cb380 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.030095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c528-1808-4ace-886d-bf25790cb380 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.031960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 166/335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:32.038091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280a6b-588c-4f9c-8230-60d511866510 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.044528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280a6b-588c-4f9c-8230-60d511866510 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.045276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a280a6b-588c-4f9c-8230-60d511866510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.071446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1a280a6b-588c-4f9c-8230-60d511866510 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:32.073111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1a280a6b-588c-4f9c-8230-60d511866510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:32.125631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.172681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:32.378812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91ea0-383f-4b8a-8978-cd16656ed637 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.379023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91ea0-383f-4b8a-8978-cd16656ed637 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.379387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f91ea0-383f-4b8a-8978-cd16656ed637 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.380935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 167/337] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:32.386541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.387122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.387596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.423193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:32.424858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:32.513828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:32.685843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91ea0-383f-4b8a-8978-cd16656ed637 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.740199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.818905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f91ea0-383f-4b8a-8978-cd16656ed637 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.876709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:32.878129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.878739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.879463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.903806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:32.912856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:32.914176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:32.915108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:32.917511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 168/339] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:32.924277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.002369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.165293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26e57f-6125-43a3-813d-cb35a33d2880 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.168136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.258659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.262715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.263636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.264061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.264169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5a66-fe59-4324-a76f-7f195f5708b9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.264598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.265422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:33.265873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.268255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.282394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 172/340] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:33.293962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.342451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.343472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.343897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.344299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.366863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:33.373821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:33.375004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:33.375990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:33.380703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 169/341] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:33.390644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.487438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd525-9bb8-4818-9a4a-57caa5b20d66 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.545097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.545649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.545929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.546200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.576439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bde81-0fb9-49e6-af82-e3e13e4cdfbe None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.600063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.627551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.630069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.630581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.631285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.633686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:33.635407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.638043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ccd48-93e0-49ad-aa40-66e075f1905e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.655868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 170/342] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:33.658498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b350-e840-475e-8784-b7615588d6c9 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.659728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b350-e840-475e-8784-b7615588d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.660379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1b350-e840-475e-8784-b7615588d6c9 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.663460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 171/343] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:33.665361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b350-e840-475e-8784-b7615588d6c9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:33.685193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.687026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540627-2149-4c14-96ff-f35e89c6deef None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.713197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.881330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1b350-e840-475e-8784-b7615588d6c9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:33.889853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 173/344] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:33.899827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.901145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.901870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.946810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:33.948459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:33.969911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.970536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.970797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.971061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.036769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.051290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 174/345] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:34.052231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.084845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.086396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90afbc3-d674-4c5a-8399-6c695902cd9c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.128800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.176252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce16e3-2c9c-4c60-b4ae-9d73c160e71a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.215117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.215772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.216054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.216328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.217511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.219084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc729b-6e3e-4a65-9a92-a0fefbaaf27a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.221121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 175/346] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.222330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8fcd-e24e-4d48-982d-75250b1bc64d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.222613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8fcd-e24e-4d48-982d-75250b1bc64d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.222885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d8fcd-e24e-4d48-982d-75250b1bc64d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.224119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 176/347] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:34.232514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8fcd-e24e-4d48-982d-75250b1bc64d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.250932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 172/348] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:34.252664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.253145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.253605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.285539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:34.287524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:34.307212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.387301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d8fcd-e24e-4d48-982d-75250b1bc64d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.396502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 173/349] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:34.396502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.461797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.473993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.475718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.476858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.479057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.495775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.498692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.500653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 177/350] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.501668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.538904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65effe5e-a0d5-47e4-b985-e9ae3f34b34b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.582292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.583134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.583484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.583892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.585235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.586854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.589025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 174/351] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.589712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.701066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449269ef-87c7-491b-b8f1-dd0d662267fc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.702949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90db01a-1a09-4bb6-851e-99415cdfb1e7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.744127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.745783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.765621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.766548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.766945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.767394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.769447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:34.770499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.770992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.771743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.773643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=70fda73f798844989b6b114060b75adb) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:34.773972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:34.777600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d00f1-e571-4a9e-aaa5-317ac4262bab None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:34.787252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:34.789436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 175/352] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:34.794543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc9ae-bad8-4088-9a35-cf64311edac6 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.794543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc9ae-bad8-4088-9a35-cf64311edac6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.794543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc9ae-bad8-4088-9a35-cf64311edac6 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1b2c320e-472d-46f3-97f0-ae3b6c48dded None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:34.798244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:34.799238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 20:07:34.800089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:34.800745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 176/353] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:34.800745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc9ae-bad8-4088-9a35-cf64311edac6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.803129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 178/354] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:34.804732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.805261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.805768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.838881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:34.845299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:34.970849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc9ae-bad8-4088-9a35-cf64311edac6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:34.992737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 179/355] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:34.992737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.030157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.031092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.031513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.031785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.033453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.035771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.038182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 177/356] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.039044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.109550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.167499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85796aa4-3577-4340-8b85-df13ceb90ad3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.188848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.196423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b22d-217f-4661-9b49-9151593959c3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.212513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.213657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.214128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.214566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.215512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:35.215986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.217669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.228194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 180/357] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.229963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.252102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.252952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.253231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.253538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.267929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ab5e1d7b-8e76-4421-b91f-7642c5b3e119 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:35.274863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:35.281758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 178/358] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:35.282992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ff82b-efae-4d3a-9867-bf5b86f5fe8c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.284300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ff82b-efae-4d3a-9867-bf5b86f5fe8c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.284300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ff82b-efae-4d3a-9867-bf5b86f5fe8c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.284300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 179/359] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:35.284300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ff82b-efae-4d3a-9867-bf5b86f5fe8c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.413090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5bb99-6881-4365-b0ee-23549a73a58e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.453842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ff82b-efae-4d3a-9867-bf5b86f5fe8c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.473907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.481660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.481871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.482230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.482546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.483523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=70fda73f798844989b6b114060b75adb) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:35.483635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.485771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92731afc-c3e2-4bb7-9635-0bdc43694385 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.492036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 181/360] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=acda13de619a41d5b6fafe2f998424fb => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.493933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.494273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.495317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.515645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:35.517022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:35.518766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.520052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.520768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.521320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] PATH_INFO: `/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.523502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] RBAC: Authorizing `identity:get_user(user_id=49231714cf1c4be9a1fbfd9e7fffeee3)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.526973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.530213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 180/361] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/users/49231714cf1c4be9a1fbfd9e7fffeee3 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.531993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.571085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.624196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 182/362] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:35.625500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.694532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d931cf-f68a-47f7-921a-54c8011396d5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.750378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.750999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.751273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.751541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.752278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:35.753040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.754102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.767173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 181/363] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.767813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.836890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.858187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f4aa3-237f-464c-a476-ef48e6fdd06b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.886397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6f110-0da2-4680-8d54-8b70a4c218e9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.929474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.930160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.930437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.930740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.931855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] RBAC: Adding query filter params (role.id=39507246e6dd42d2ace529471fbe1b2a, user.id=49231714cf1c4be9a1fbfd9e7fffeee3, scope.system=all) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:35.932242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.935299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.949214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 182/364] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/role_assignments?user.id=49231714cf1c4be9a1fbfd9e7fffeee3&scope.system=all&role.id=39507246e6dd42d2ace529471fbe1b2a => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:35.950085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:35.955116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.955799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.956083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.956356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.008731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:36.021831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:36.023641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:36.025636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 183/365] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:36.030281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.114487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.184104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.195665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be1b4-7473-4b01-ba59-60847f09b27f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.228154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abef3a3-ee08-4305-aa43-b0b7cdf939da None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.266276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.267301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.267771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.268208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.280625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.281333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.281684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.281960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.282784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:36.283096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.285377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.297982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.297982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.362614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.364325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.410196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.417286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641801d5-f928-4acd-b0a9-1757461a59aa None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.454592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.455249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.455575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.455799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.467927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:36.473493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:36.474436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 185/367] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:36.476620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.527349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.528484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 183/368] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:36.529928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.649528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df79d03-a19f-44e1-9eaf-2008775bafb4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.686663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c6b4f-c951-4a72-b502-e802c911891d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.704306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.705611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.706120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.706585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.738250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.738879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.740753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.741114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.741912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:36.742187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.742315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.743900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.763299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.764300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.807486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.809601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.842994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:36.913082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387685a5-c79e-4f6b-9927-c3f13419773a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:36.955008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 186/370] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:36.955874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:36.973250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:36.974426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:36.974753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:36.975023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:36.977888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:36.979929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:36.982410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:36.983970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.046708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.119180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022299d8-acf1-4bb8-916f-ac5a797535d5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.128978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad9e4-3e28-445a-87f9-111c919a6389 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.183568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.185272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.185272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.185566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.195408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.209388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.211281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.212363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.213199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.215616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.219475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.225328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 186/372] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.226569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.306172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.308210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.373189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.383889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70457-b0bc-4d9b-a7cb-d21d5fbc3d21 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.431169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.432051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:37.432590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.433057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.433392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.433762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.434831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.437143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.439414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 187/374] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.440410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.520123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.565180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b8600-6f7d-4d0e-851b-96bba9ba7e70 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.588455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba39283-7c32-4792-b484-0e0aadb67612 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.626710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.627402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.627964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.628482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.631050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.632873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.634400 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 188/375] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.635265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.655234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.656712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.657357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.657749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] PATH_INFO: `/v3/projects/02370ea83738498ab52b54a7db5f2ba5` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.659100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=02370ea83738498ab52b54a7db5f2ba5)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.661906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de15136-e9e9-4347-8317-8b336ab33ac7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.663986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/projects/02370ea83738498ab52b54a7db5f2ba5 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.665501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6d2-a3c2-4469-9454-5fd46614650a None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.665780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6d2-a3c2-4469-9454-5fd46614650a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.666114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6d2-a3c2-4469-9454-5fd46614650a None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.668549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 189/377] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:37.669328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8d6d2-a3c2-4469-9454-5fd46614650a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:37.681738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.790965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf3c6a-758b-4f59-b718-d39da85cbbc7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.851957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.853116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.853598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8d6d2-a3c2-4469-9454-5fd46614650a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:37.854172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.854672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.855659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:37.856597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.859613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8026f39-2708-4003-b2ad-95af5404f09c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.868007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.869819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.870649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.871136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.894406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:37.895952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:37.897294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.907461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:37.908681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.909451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.910054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.911364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:37.911792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:37.914850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:37.932760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=acda13de619a41d5b6fafe2f998424fb => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:37.932760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.007636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 190/380] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:38.078939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e545d7-a319-49e2-86fe-efe348ba70cd None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:38.125703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:38.126376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.126646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.126905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] PATH_INFO: `/v3/groups/9a569edd899d46dfa78865a63e0bf005` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.134707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] RBAC: Authorizing `identity:get_group(group_id=9a569edd899d46dfa78865a63e0bf005)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:38.136811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320975d5-20d2-4d49-9a94-e96e6c9226b9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:38.138948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 191/381] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:37 2022] GET /identity/v3/groups/9a569edd899d46dfa78865a63e0bf005 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:38.145024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.184507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:38.226841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e3c8-6fa9-417b-ada9-1c59fc59507f None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.227182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e3c8-6fa9-417b-ada9-1c59fc59507f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.227414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e3c8-6fa9-417b-ada9-1c59fc59507f None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.229474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 192/382] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:38.235644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.235965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.236182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.271838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:38.274396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:38.322813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268dab-e0ac-48e7-955d-4610f981bce3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:38.379359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:38.381623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.382150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.382802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.388036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] RBAC: Adding query filter params (group.id=9a569edd899d46dfa78865a63e0bf005, role.id=094fcef4654043758d8a01fad877074a, scope.project.id=02370ea83738498ab52b54a7db5f2ba5) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:38.388511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:38.391799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:38.415364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:38 2022] GET /identity/v3/role_assignments?group.id=9a569edd899d46dfa78865a63e0bf005&scope.project.id=02370ea83738498ab52b54a7db5f2ba5&role.id=094fcef4654043758d8a01fad877074a => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:38.419381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:38.450042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:38.454352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.599706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:38.625186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031670-da9d-4282-a0c8-0e1e27c907d2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:38.679672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:38.680322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.680622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.680887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.694843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:38.702151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:38.703155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:38.703948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:38.705087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:38.712158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.813766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.954826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960d3c-bcef-4095-89d3-80b1893a04d1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:38.988040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd934-0f86-4e40-85cd-571e78342061 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.057763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.058819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.059303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.059776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.061078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:39.061606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.064199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.066710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.067791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.068259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.068728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.094192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:39.102897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:39.106653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:39.113148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:39.114883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:39.116438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 193/387] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:39.120219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.121850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.239232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:39.337447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ffbd-6afa-4bc5-a99b-c0898b1a6c64 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.387573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.388198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.388521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.388768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.389928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.391577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.393736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 195/388] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:39 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:39.402504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.424898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121cf3-3ab2-41b2-880a-5895120d71c2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.479781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.480640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.480938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.481207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.481896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:39.482204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.483617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.509066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 194/389] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:39.515145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.613497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:39.644613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e001c0-bcba-4264-8ede-acf77e7e7506 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.697156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ee64c-523b-4837-ae39-e4d6168370de None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.712020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:39.748584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.749266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.749549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.749822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.751222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.752739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.754360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 195/390] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:39 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:39.755845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.756569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.756967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.757113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.758239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.759853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.761663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 196/391] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:39 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:39.763342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.771428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:39.908001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1b6e7-1cd7-45b9-807d-69a2aa2da55a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:39.947183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:39.948067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:39.948347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:39.948758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/groups/f86272160eea44beb6d12d0eb1b53790/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:39.951766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, group_id=f86272160eea44beb6d12d0eb1b53790, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:39.953282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:39.970105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 197/392] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:39 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/groups/f86272160eea44beb6d12d0eb1b53790/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:07:39.970643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35568977-6f28-4e17-8fab-cdca5dd93209 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:40.017215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:40.033299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adba864-30b5-4805-a040-89b555059572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:40.033981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba864-30b5-4805-a040-89b555059572 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.034258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba864-30b5-4805-a040-89b555059572 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.034531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adba864-30b5-4805-a040-89b555059572 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.035883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adba864-30b5-4805-a040-89b555059572 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:40.037416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adba864-30b5-4805-a040-89b555059572 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:40.041184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 196/393] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:39 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:40.048239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:40.140143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:40.245378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978fe7e-522a-4f62-8e9f-8de74d19b910 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:40.321925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:40.323095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.323696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.324020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb/groups/f86272160eea44beb6d12d0eb1b53790/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.327793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] RBAC: Authorizing `identity:create_grant(project_id=70fda73f798844989b6b114060b75adb, group_id=f86272160eea44beb6d12d0eb1b53790, role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:40.330485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a936c-8c5e-43cb-888e-012e7862a813 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:40.359182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 198/394] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:40 2022] PUT /identity/v3/projects/70fda73f798844989b6b114060b75adb/groups/f86272160eea44beb6d12d0eb1b53790/roles/acda13de619a41d5b6fafe2f998424fb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:40.823784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e63f4-d2db-4793-b01a-6505c253442a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.824321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e63f4-d2db-4793-b01a-6505c253442a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.824321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e63f4-d2db-4793-b01a-6505c253442a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.826094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 197/395] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:40.831993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1abad-dc80-4873-bc39-68c408facaf6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:40.832688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1abad-dc80-4873-bc39-68c408facaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:40.832688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1abad-dc80-4873-bc39-68c408facaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:40.856710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a3d1abad-dc80-4873-bc39-68c408facaf6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:40.858270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a3d1abad-dc80-4873-bc39-68c408facaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:40.952771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 199/396] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:41.128327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf85bd-e108-4879-9d3e-91fa712f84a1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.128691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf85bd-e108-4879-9d3e-91fa712f84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.129040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf85bd-e108-4879-9d3e-91fa712f84a1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.131223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 198/397] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:41.136938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a3f3-7977-4800-9861-c466b617c74b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.137223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a3f3-7977-4800-9861-c466b617c74b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.137473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a3f3-7977-4800-9861-c466b617c74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.165431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-06b6a3f3-7977-4800-9861-c466b617c74b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:41.166830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-06b6a3f3-7977-4800-9861-c466b617c74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:41.211194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.263252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 200/398] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:41.394308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf85bd-e108-4879-9d3e-91fa712f84a1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.488021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85160-d89b-4882-a7d5-f6f9854883ec None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.488430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85160-d89b-4882-a7d5-f6f9854883ec None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.488631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85160-d89b-4882-a7d5-f6f9854883ec None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.490825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 201/399] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:41.505015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.505344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.505881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.540845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:41.546034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:41.639074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf85bd-e108-4879-9d3e-91fa712f84a1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:41.694384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:41.740552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:41.741636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:41.742119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:41.742600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:41.768266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:41.787663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:41.789102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:41.790302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 199/401] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:41.797258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.827990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:41.910949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:41.962615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4d88-daca-4b58-a6f0-6f3f6aad69d2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.003450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.004491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.004968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.005459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.018144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:42.023873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:42.024861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:42.026232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:42.028678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 200/402] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:42.038175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.093353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8914-0b30-42c6-899d-a45c2fb00d5e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.160841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.161907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.162384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.162875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.163634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae6c4-bf37-4664-a261-935badfa46ae None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.163917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:42.164475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.167431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.186119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 203/403] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.187282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.193638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.205070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.206034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.206551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.207062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.208097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:42.208632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.210432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.222143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 201/404] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.223322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.326283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372537c-75a3-44ad-a0bc-6e6201ef7fa7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.338552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8393c-aae9-4cc9-a1a4-63adf84a0a03 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.373846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.374913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.375199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.375612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.384615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.386124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.386976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.387667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:42.388022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.389986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.393268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:42.395218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:42.396902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:42.398089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:42.401029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 204/405] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:42.402571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.405526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 202/406] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.407313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.441280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.482448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.545857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333eb5-61f3-4a99-af86-08aa592d2c20 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.557080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fce77c-d198-4dd0-aee9-ec25fc8ec482 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.585019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.586043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.586518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.586978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.587850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:42.588426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.590513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.599854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.601075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.626554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.627659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.628155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.628804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.631100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.634229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.637916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.641393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.723276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aed48-8fa6-4786-a834-cff451a2bf91 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.736220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.766052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.767639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.768486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.769263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.771393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.774173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.778162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.779384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.789794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.809151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349cb3-69de-4a8e-bd67-a2ad907ba158 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.864551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.865005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.865279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.865544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] PATH_INFO: `/v3/groups/9a569edd899d46dfa78865a63e0bf005` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.867055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] RBAC: Authorizing `identity:get_group(group_id=9a569edd899d46dfa78865a63e0bf005)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.868382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.870479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/groups/9a569edd899d46dfa78865a63e0bf005 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.872062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.892269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1cc96-a95a-46ba-a6e8-1c898dc20d39 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:42.933722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:42.934689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.935154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.935622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.937197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:42.939220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:42.941317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 205/411] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:42.945141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.009996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.033347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c048-66ae-4359-a117-b0be6b135032 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.071751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.072430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.072762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.073361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad9505-fbcf-44f5-b840-02e71483829b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.073659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/groups/f86272160eea44beb6d12d0eb1b53790/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.076214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, group_id=f86272160eea44beb6d12d0eb1b53790, role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.077833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb0944-0e34-4e5d-bdbe-7bef015533f2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.097372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 207/412] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:42 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/groups/f86272160eea44beb6d12d0eb1b53790/roles/acda13de619a41d5b6fafe2f998424fb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:43.098632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ccd6-a1b1-40cf-988a-2208e84a7b90 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.098913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ccd6-a1b1-40cf-988a-2208e84a7b90 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.099181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0ccd6-a1b1-40cf-988a-2208e84a7b90 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.100735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 208/413] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:43.101218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ccd6-a1b1-40cf-988a-2208e84a7b90 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.126755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.131679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.131679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.131679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.134635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] PATH_INFO: `/v3/projects/02370ea83738498ab52b54a7db5f2ba5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.137173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] RBAC: Authorizing `identity:get_project(project_id=02370ea83738498ab52b54a7db5f2ba5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.138597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bec18c-bd0c-4fe4-b1db-5d40fefa248b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.140747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 206/414] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/projects/02370ea83738498ab52b54a7db5f2ba5 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:43.149173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73e48-f83c-4471-9752-b53f0e6e0b9f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.150696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73e48-f83c-4471-9752-b53f0e6e0b9f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.152211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73e48-f83c-4471-9752-b53f0e6e0b9f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.155462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 207/415] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:43.159620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.160748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.161480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.189637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:43.191004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:43.276160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0ccd6-a1b1-40cf-988a-2208e84a7b90 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.312314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 208/416] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:43.313199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.331848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.332830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.333193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.333530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/groups/f86272160eea44beb6d12d0eb1b53790/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.335639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef92a33d3a774fb9ae43197058e11bf2, group_id=f86272160eea44beb6d12d0eb1b53790, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.337221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2890b2-671a-47e0-abbf-6e8bb4b1d817 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.371299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 209/417] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:43 2022] PUT /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2/groups/f86272160eea44beb6d12d0eb1b53790/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:43.371299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.371299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.371299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.399627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:43.402326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:43.430691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.527614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3ff6d-5a51-4444-8da4-022f1acfb426 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.552543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:43.607516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.608224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.608630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.608903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] PATH_INFO: `/v3/projects/02370ea83738498ab52b54a7db5f2ba5/groups/9a569edd899d46dfa78865a63e0bf005/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.611544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] RBAC: Authorizing `identity:create_grant(project_id=02370ea83738498ab52b54a7db5f2ba5, group_id=9a569edd899d46dfa78865a63e0bf005, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.613309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.633997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 209/419] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Aug 29 20:07:43 2022] PUT /identity/v3/projects/02370ea83738498ab52b54a7db5f2ba5/groups/9a569edd899d46dfa78865a63e0bf005/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:07:43.748047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:43.757572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.904838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0329-9b8d-405a-975f-6ea52ea54068 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.966428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.967350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.967662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.968060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.986277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:43.992728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:43.994345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:43.997507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:44.002491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 211/420] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:44.004227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.017978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.151401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:44.227548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704b2f9-09ad-4fae-a65e-114f9f1f1e35 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.266801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d26cc-0c94-41fc-9a1f-fa1ca681c876 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.271861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:44.301105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.302136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.302603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.303068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.323148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:44.333546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:44.335270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:44.336437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 212/421] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:44.347360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.383100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.384096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.384412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.384716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.385464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] RBAC: Adding query filter params (name=member) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:44.385859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:44.387693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:44.403750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 210/422] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:44.405483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.550058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62467a-809f-4070-93b3-74f92f1b0d83 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.601681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.602930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.603268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.603735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.657037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:44.690433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:44.692178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:44.795694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a05362-ae43-4cd5-8f3d-eae2f3c766ff None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:44.841314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:44.848915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:44.884833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:44.918171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:44.919155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:44.919636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:44.920111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:44.921362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:44.921889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:44.924489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:44.941215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 213/424] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:44.952106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:45.088970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:45.166873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aff8e-0eeb-4b13-82b6-6e995a0bd476 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:45.205537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aa7f-1175-4fc1-84f8-86fe9a737310 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:45.261831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:45.262508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.262791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.263066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.265549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:45.267023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:45.268749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 212/425] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:45.276628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:45.290555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:45.291407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.291722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.292143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.416149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fd8c5-baa7-4cf5-9a55-c4bac6a3b16f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:45.459713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:45.460275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.460605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.460906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.462148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:45.464836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:45.471948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 213/426] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:45 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:45.473728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:45.481911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:45.492773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:45.527348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:45.528903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f158-3350-4d79-bffd-506b43daf54f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:45.613850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d790-5a2d-4177-ad49-ce5cc3d41462 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:45.662480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:45.663117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.663447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.663723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.664485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=70fda73f798844989b6b114060b75adb) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:45.664797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:45.666836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:45.675477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 214/427] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:45 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:45.779341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 214/428] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:45.785370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:45.884582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58596b62-05fe-49ac-8334-2e04340e6107 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.884899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58596b62-05fe-49ac-8334-2e04340e6107 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.885124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58596b62-05fe-49ac-8334-2e04340e6107 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.886923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 215/429] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:45.892625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:45.892895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:45.893305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:45.903923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:45.938358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:45.939576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:45.967991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1607-d988-49ec-a89d-f217434eb62c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.020330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.022164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.022726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.023192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] PATH_INFO: `/v3/projects/70fda73f798844989b6b114060b75adb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.027359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=70fda73f798844989b6b114060b75adb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.030340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.033364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 215/430] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:45 2022] GET /identity/v3/projects/70fda73f798844989b6b114060b75adb => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:46.039346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.067863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 216/431] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:46.195023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e9df-13fa-4251-9775-0fc2fa5f3bf1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.238970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.239620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.239897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.240163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.241354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.242815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39cd15-1b43-4867-b6bd-05c797b8e8ab None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.245154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 216/432] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:46.253568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.278481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557a0b-9ea0-4f34-9f13-c000fea645f9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.278481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557a0b-9ea0-4f34-9f13-c000fea645f9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.278481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557a0b-9ea0-4f34-9f13-c000fea645f9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.279875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 217/433] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:46.280526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.289508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212898-188d-45c8-81d9-3358931954cb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.290187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212898-188d-45c8-81d9-3358931954cb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.290854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6212898-188d-45c8-81d9-3358931954cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.300302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.332440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b6212898-188d-45c8-81d9-3358931954cb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:46.332440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b6212898-188d-45c8-81d9-3358931954cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:46.393226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e04bb8-d765-431d-8ae3-43467610f9ee None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.423980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 218/434] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:07:46.425962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e56e-d07a-4132-bd7f-894f4e77e6dd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.426261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e56e-d07a-4132-bd7f-894f4e77e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.426513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5e56e-d07a-4132-bd7f-894f4e77e6dd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.428019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 219/435] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:46.434178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e56e-d07a-4132-bd7f-894f4e77e6dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.448808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.449816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.450117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.450793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.451711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=70fda73f798844989b6b114060b75adb) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:46.452312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.453857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1993f-28ab-493f-a2a3-33dfb398541c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.465819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 217/436] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=70fda73f798844989b6b114060b75adb&role.id=acda13de619a41d5b6fafe2f998424fb => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:46.466015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.466232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.466455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.501657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:46.505258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:46.604842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5e56e-d07a-4132-bd7f-894f4e77e6dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.637981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 218/437] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:46.657694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.661152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.661814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.662306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.662581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.678721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:46.684506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:46.686312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:46.687930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 220/438] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:46.693450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.719501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.749151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.850216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a24f5f-e54c-44b8-9b82-30808b2df05c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.905914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.906542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.906812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.907069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.907938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:46.908263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:46.910865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:46.922441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904ac8f-b83b-44d3-bf8a-c7748ea6548e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.925311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 219/439] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:46.934555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.971437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:46.972536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.973064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.973567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.989661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:46.992329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:46.993431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:46.994335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 221/440] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:47.000058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.060193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.068295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.093404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b795-afd4-44aa-9069-1f2ab516f25d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.125519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a0ff0-1de4-421e-9f53-f8bb3de7bbc0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.130445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.131084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.131353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.131615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.170325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.170844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.171128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.171718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.172108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.172425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.173865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.183391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:47.184239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.238508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.239968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.300227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe61-0d07-4394-ac17-3c93dc3fe96c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.317147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.338983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.344598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.345254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.345533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.345796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.361946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:47.367735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:47.369559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 223/442] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:47.370942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.371696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 220/443] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:07:47.375897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.496293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69308dd6-79ff-4ba9-bff4-6ad1446e97fa None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.511695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c699ef8-af6b-4d25-abc2-fdacd049ac21 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.537251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.537874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.538154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.538431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.556428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.557071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.557863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.558210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.558949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:47.559258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.560841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.576366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 221/444] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:47.576366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.596649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.623623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.626493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.628204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.700842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8cbec-2074-403e-ac6b-dfec30ebea9e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.740241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.740923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.741204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.741473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.742676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.744134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.745987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 222/445] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.746847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.751602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 224/446] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:47.751699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.839398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.869340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efef4-8a31-4781-acaa-142f7c4757f2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.875653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768ed80-405a-489d-ac38-96fb52fd8e7a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:47.878272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.908575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.909234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.909515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.909783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.910944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.912417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.914052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 225/447] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:47.914855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:47.923399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.924022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.924302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.924597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.003667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.005099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.027068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88d5a-7720-4a55-9acc-8a09ac81278a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.070620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.071282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.071567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.071833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] PATH_INFO: `/v3/projects/02370ea83738498ab52b54a7db5f2ba5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.073010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] RBAC: Authorizing `identity:get_project(project_id=02370ea83738498ab52b54a7db5f2ba5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.074470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.076143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 226/448] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/projects/02370ea83738498ab52b54a7db5f2ba5 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.077037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.091220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.122320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 223/449] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:48.125931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.130142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.207001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ae59-adca-41da-b00a-cd779f2e62ba None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.243169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd49240-4193-49de-addc-888f9b83fffe None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.251524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.252134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.252430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.252722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.253444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.254048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.255381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.276476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 227/450] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=acda13de619a41d5b6fafe2f998424fb => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.276476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.286480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.287774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.288071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.288336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] PATH_INFO: `/v3/groups/9a569edd899d46dfa78865a63e0bf005` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.290073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] RBAC: Authorizing `identity:get_group(group_id=9a569edd899d46dfa78865a63e0bf005)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.291686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.294118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 224/451] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/groups/9a569edd899d46dfa78865a63e0bf005 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.300137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.380233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.410442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.420173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d4f83-457d-4dc5-8d4b-032f227c1b5b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.453959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75fb1-95ce-497d-85b2-f1ab53aab6fb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.475463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.476111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.476385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.476742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] PATH_INFO: `/v3/projects/ef92a33d3a774fb9ae43197058e11bf2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.478000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] RBAC: Authorizing `identity:get_project(project_id=ef92a33d3a774fb9ae43197058e11bf2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.479592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.481493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 228/452] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/projects/ef92a33d3a774fb9ae43197058e11bf2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:48.487037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.507276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.507807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.508078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.508342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.509162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] RBAC: Adding query filter params (group.id=9a569edd899d46dfa78865a63e0bf005, role.id=094fcef4654043758d8a01fad877074a, scope.project.id=02370ea83738498ab52b54a7db5f2ba5) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.509450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.511036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.517565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 225/453] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/role_assignments?group.id=9a569edd899d46dfa78865a63e0bf005&scope.project.id=02370ea83738498ab52b54a7db5f2ba5&role.id=094fcef4654043758d8a01fad877074a => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:48.628462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13d52-f406-4ebb-8f96-895ca9a0eeae None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.672227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.673282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.673751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.674204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] PATH_INFO: `/v3/groups/f86272160eea44beb6d12d0eb1b53790` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.676141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] RBAC: Authorizing `identity:get_group(group_id=f86272160eea44beb6d12d0eb1b53790)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.679059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a45af-deda-4c4b-9655-346b2956cf2a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.686381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 229/454] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/groups/f86272160eea44beb6d12d0eb1b53790 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:48.688353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:48.814729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3e9f-8d19-4851-a889-a24c05e2bcc5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:48.852262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:48.852891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:48.853243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:48.853425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:48.854397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] RBAC: Adding query filter params (group.id=f86272160eea44beb6d12d0eb1b53790, role.id=7b370c51ccfb42a3817e8b6aca7d0483, scope.project.id=ef92a33d3a774fb9ae43197058e11bf2) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:48.854530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:48.855927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e441f2-bdb6-4ded-a9f2-9d371690a1e3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:48.859104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:48.865588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 226/455] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Aug 29 20:07:48 2022] GET /identity/v3/role_assignments?group.id=f86272160eea44beb6d12d0eb1b53790&scope.project.id=ef92a33d3a774fb9ae43197058e11bf2&role.id=7b370c51ccfb42a3817e8b6aca7d0483 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:51.722019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf93e-6621-4f07-ae50-b865192b5222 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.722546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf93e-6621-4f07-ae50-b865192b5222 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.722546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf93e-6621-4f07-ae50-b865192b5222 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.724361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 230/456] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:51.729684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486b-0408-4830-963f-789f8b1d0ce0 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.730980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486b-0408-4830-963f-789f8b1d0ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.731566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486b-0408-4830-963f-789f8b1d0ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.752214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-efd9486b-0408-4830-963f-789f8b1d0ce0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:51.753773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-efd9486b-0408-4830-963f-789f8b1d0ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:51.821721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c9a4-4733-4c21-b81d-f87662421fc0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.822397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c9a4-4733-4c21-b81d-f87662421fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.822864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c9a4-4733-4c21-b81d-f87662421fc0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.825871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 231/457] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:51.830729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:51.831265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:51.831746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:51.864752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 227/458] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:51.865711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:51.866906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:51.884773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:51.968458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:52.208636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30375d-cac2-48b9-88ce-d8c608b13255 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.209341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30375d-cac2-48b9-88ce-d8c608b13255 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.209841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30375d-cac2-48b9-88ce-d8c608b13255 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.211780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 228/460] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:52.217541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.218116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.218615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.222757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.249587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:52.251761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:52.361800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:52.373387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d625-88a0-4f7a-98e8-4039cb424be3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.388542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.418136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.418779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.419056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.419325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.437198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.440344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.441878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.457904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:52.465799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:52.466839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:52.467972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:52.467972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.467972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:52.468155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 233/462] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:52.473348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.512745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724b78c-54f5-4eb8-95da-025c20a73a7a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.553836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.554480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.554755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.555020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.567513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.569611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-1caaa9c7-4307-4648-87f3-5c2924111d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:52.590046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:52.591248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:52.592154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:52.592154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:52.592154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:52.592154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 230/463] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:07:52.596457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9614-3955-4481-a7b0-adb1daf71a6c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.596457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9614-3955-4481-a7b0-adb1daf71a6c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.596457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9614-3955-4481-a7b0-adb1daf71a6c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.596457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 231/464] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:52.598567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9614-3955-4481-a7b0-adb1daf71a6c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.641223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4c998-9b41-4916-a1bb-7947323ea981 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.684800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.685383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.685571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.685973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.686490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:52.686822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.688350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927706d7-9959-4953-b8a7-4044bf7f63f0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.716432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 234/465] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:52.716432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.716432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.716432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.732590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:52.733805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:52.738383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9614-3955-4481-a7b0-adb1daf71a6c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.755724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.781864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.782369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.782750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.783020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.783677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:52.783975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:52.785526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:52.788639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.799165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 232/466] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:52.804455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.815830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 235/467] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:52.816723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:52.944049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7afb56-f6a0-4321-ab46-61cc0ca1de56 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.976585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19babb-f6af-4311-aba6-102372d37d8c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:52.994802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:52.996329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.996814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.997254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.011563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.014056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:53.033631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:53.034577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:53.035442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:53.035442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:53.035442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:53.037743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 233/468] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:53.038753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.065384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.066961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.068229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.069186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.070786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.074437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.080583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.117510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 236/469] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:52 2022] POST /identity/v3/users => generated 246 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:53.119425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.178281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.218864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b7db-d5ab-43cf-a4f2-2c11c0d6d39c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.259136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d3b08-6d88-4ac3-9b61-c5dc44ebed65 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.272954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.273945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.274457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.274938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.276631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.278791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.301872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.302763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.303241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.303653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.304549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:53.305051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.307209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.314124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 234/470] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:53 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:53.315920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.326803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 237/471] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:53.335917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.497479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.512170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.520534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095c-a3fb-4e23-a367-d01377c825b1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.534459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed057e4-8223-4396-8b07-4d36deb88542 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.580567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.581105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.581378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.581662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.582854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.585224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.585984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.586717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.588208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.592716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefebe00-7d6b-4143-a009-4f5d7e8289ea None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.599774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.601292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-6bcaf6ec-4ada-4ebb-98cd-339491d6b3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:53.626964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:53.628707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 235/472] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498682fe-cea4-4125-ba15-5639846c6189 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498682fe-cea4-4125-ba15-5639846c6189 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.631017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498682fe-cea4-4125-ba15-5639846c6189 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.632449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 236/473] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:53.637468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498682fe-cea4-4125-ba15-5639846c6189 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.643739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 238/474] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:53 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:53.646440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.647218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.648671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.681069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:53.684846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:53.829552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 239/475] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:53.841309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498682fe-cea4-4125-ba15-5639846c6189 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.876834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.882218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.883107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.883529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.883964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.884897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:53.885390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.887869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.903734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 237/476] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:53.909336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.014637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.038867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592d132-7188-4960-87e7-3f4f4f06444d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.085816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.086841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.087339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.087814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.088887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.090737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.115116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 240/477] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:53 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:07:54.200405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.319990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d483930-4d64-4e98-8953-561f4389fcec None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.359462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.360169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.360338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.360631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.361326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.362725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.371826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.sql.core [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:54.371826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:07:54.371826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [parameters: {'id': '1446de9cd4684c3aa2bdc494cee3d5cd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:07:54.371826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81651) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result.read() Aug 29 20:07:54.390076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:07:54.391687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application yield resource Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise self.value Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application session.commit() Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:07:54.395096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:07:54.403011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:07:54.406164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result.read() Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:07:54.409635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [parameters: {'id': '1446de9cd4684c3aa2bdc494cee3d5cd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:54.415351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:07:54.418551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:54.421565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 238/478] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Aug 29 20:07:54 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:54.421793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.534205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5ba3-f242-4528-bd65-b8b9a3ece4e9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.576285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.577127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.577529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.577801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.586257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.590347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-eafff4db-6cb3-4227-b161-34291ce5f92e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:54.596296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:54.597282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:54.598096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 241/479] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:54.603911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:54.674220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:54.742259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e278e-13d5-4430-8b09-518b4b1984cc None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:54.801422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:54.802399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:54.802898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:54.803357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:54.804232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:54.804755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:54.806353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be122e-b622-41e9-a6c6-fa947a8664b5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:54.820745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 239/480] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:07:55.721281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e084-7b59-49f5-9bda-715c4cad11c2 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.721813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e084-7b59-49f5-9bda-715c4cad11c2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.721813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e084-7b59-49f5-9bda-715c4cad11c2 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.723172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 242/481] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:55.730376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0d89-34e1-457f-91bb-7fad349ad334 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.730964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0d89-34e1-457f-91bb-7fad349ad334 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.730964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb0d89-34e1-457f-91bb-7fad349ad334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.762809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e6fb0d89-34e1-457f-91bb-7fad349ad334 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:55.764010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e6fb0d89-34e1-457f-91bb-7fad349ad334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:55.871399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 240/482] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:55.979210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bdfa-a6df-4b07-82fe-436cd31129b1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.979210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bdfa-a6df-4b07-82fe-436cd31129b1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.979210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bdfa-a6df-4b07-82fe-436cd31129b1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.982722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 243/483] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:55.986431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.986716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.986977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.007505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:56.008733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:56.074716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.109204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 241/484] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:56.250263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bdfa-a6df-4b07-82fe-436cd31129b1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.414232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bdfa-a6df-4b07-82fe-436cd31129b1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.464498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.465677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.465962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.466288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.487553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:56.493821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:56.495321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:56.496148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 244/485] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:56.505196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.624368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.670722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8169-9f9a-4142-860c-af05bfa808c3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.719015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.730943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.733449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.734530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.735291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.736665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:56.737170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:56.739025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdac04-8872-4de2-bc69-78b02db92056 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:56.750005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 242/486] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:56.751733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b3db3-3874-4606-9179-5c984a4d8510 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.752167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b3db3-3874-4606-9179-5c984a4d8510 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.752607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b3db3-3874-4606-9179-5c984a4d8510 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.754033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 243/487] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:56.759871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b3db3-3874-4606-9179-5c984a4d8510 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.782707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b73643-6818-41a8-bee8-c607948e7937 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.832897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.833795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.834085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.834455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.841013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.849890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-417db6ba-9585-4f8b-b47e-bbc0dd5b4567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:56.859579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:56.860599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:56.861395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:56.864701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 245/488] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:56.866020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da8fc-e870-473d-890f-bc2a9a00377a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.866305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da8fc-e870-473d-890f-bc2a9a00377a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.866576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da8fc-e870-473d-890f-bc2a9a00377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.889851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-026da8fc-e870-473d-890f-bc2a9a00377a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:56.891736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-026da8fc-e870-473d-890f-bc2a9a00377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:56.930977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b3db3-3874-4606-9179-5c984a4d8510 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.994314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.995284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.995681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.996858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.002029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 246/489] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:57.003661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fc51-9cc1-48f9-b401-087895d227a9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.004126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fc51-9cc1-48f9-b401-087895d227a9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.004557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fc51-9cc1-48f9-b401-087895d227a9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.011508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 247/490] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:57.012997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36fc51-9cc1-48f9-b401-087895d227a9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.016551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.019886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-50738221-0555-412d-9685-8dbb26f3533a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:57.054754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.056460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:57.058199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:57.058199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.058199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:57.062175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 244/491] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.064857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.065669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.066396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.091243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.107545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:57.110663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:57.168172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36fc51-9cc1-48f9-b401-087895d227a9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.213122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.213785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.214713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.215068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.215808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.216116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.217741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.229049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 248/492] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.230446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.296648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 245/493] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:57.297719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.356225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.376774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c6c6-9849-403d-918a-ff504ba98f15 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.393652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.426310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.427577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.428078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.428583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.430242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.430837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.433244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.453223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 249/494] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.454409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.496251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d6f3-9bc8-40cc-9588-55206a273e2d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.535189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.536160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.536601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.537006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.549634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.551459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:57.568565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.569753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:57.570790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:57.570790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:57.570790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:57.572524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 246/495] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.573797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.586756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14d401-414b-43b2-861a-913c2a04dfd2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.629380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.630018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.630415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.630879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.642349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:57.647199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.648322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:57.649581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:57.653739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 250/496] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.654321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.670071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.691714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.700792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e87c-130e-4a24-b73c-c0413fcc864a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.738132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.738824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.739212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.739492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.747883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.749410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-6bb9c5c6-4dbd-4ef0-9170-c2ee5f066c45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:57.762867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:57.763854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:57.764835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 247/497] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:57.765444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec4dbc-680f-4665-90b9-48a3aff0af7d None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.766001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec4dbc-680f-4665-90b9-48a3aff0af7d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.766001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec4dbc-680f-4665-90b9-48a3aff0af7d None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.767232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 248/498] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:57.771472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec4dbc-680f-4665-90b9-48a3aff0af7d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.780960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f751eac-b262-4be0-90fc-daf9b542d03a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.824450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.825112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.825367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.825558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.826207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.826520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.828028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.841002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 251/499] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.841868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:57.904051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec4dbc-680f-4665-90b9-48a3aff0af7d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.940346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:57.940977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.941252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.941520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.942182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:57.942477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:57.943871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04e902-c34d-4890-ab5d-8ed8307525f4 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:57.945273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.953356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 249/500] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:57.954623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:57.954768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:57.954866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:57.955179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:57.970931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ebf1-9660-4cc2-9a3d-619e8c16f22c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:57.976074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:57.977321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:58.015615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.016245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.016566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.016815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.017641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.017887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.019364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.059227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 252/501] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:07:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.060198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.066133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 250/502] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:07:58.066988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.181974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2b85-758a-4807-b2da-199da948755c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.182224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e9c1d-2045-4a01-82d5-24d76e874dd1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.216885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.225393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.226033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.226362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.226770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.237975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.238334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.238608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.238871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.242063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:07:58.247828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.249059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:07:58.249849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:58.251775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.252840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 253/503] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.253303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.255194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:58.267851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.268952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:58.269903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 251/504] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.270845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.281414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.395459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138e21-f2df-4f3e-ba28-c5489d64d54f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.395774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97791-85c1-4b66-a12f-ab7c5553e5dc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.431490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.432153 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.432371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.432731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.432864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.433375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.433793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.434061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.445419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.446915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:58.462315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.463356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:58.464750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:58.464750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.464750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:58.464750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 254/505] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.465649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.494375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.509823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.512072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.537536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.578663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8d76-8c5d-4b54-bcba-947097a23172 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.615747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.616402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.616761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.617016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.617689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.617998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.618941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 252/506] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:58.619461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.619810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.628801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 255/507] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.629592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.720652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.740163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682773-8d46-4448-8b86-b4bf1ca2b34b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.759668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6af4-e001-40d6-a6c7-c3733d8fcac2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.783680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.784433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.784945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.785256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.786141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.786304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.787767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.790341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:58.803411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.804067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.804336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.804915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.817676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.819750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:58.830910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 253/508] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:58.831814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:58.838095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:58.841112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:58.842162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:58.842162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:58.842162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:58.842162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 256/509] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:58.842162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:58.951229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1ccec-2b04-4ff7-bab9-d828458e2a35 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.976508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34610c1-8d96-4d00-80ba-b07162bc3d4a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:58.990990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:58.991793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:58.992256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:58.992749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:58.993814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:58.994128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:58.995623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.008149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 254/510] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.009536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.013775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.025404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.026404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.026684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.027027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.038659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.043290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:59.057873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.059241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:59.060129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:59.060129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.060129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:07:59.060129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 257/511] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.060354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.094167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.121609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805861-cdc8-4c09-8bf2-f5738fc029fb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.161109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.161757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.162028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.162296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.174344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.175539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9fee6-4013-4e5a-a449-f530f8889077 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.175843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:59.193171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.194249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:59.195571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:59.195571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.195571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:59.195571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 255/512] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.195571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.217204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.217827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.218098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.218364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.261214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.293283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.294747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.308935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdb5e7-0595-48b5-97a8-28a6b061144c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.323902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.345192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.345868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.346145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.346405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.347108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.347409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.348861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.360929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 256/513] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.361821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.421813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 258/514] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:07:59.422672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.487616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc6b7-8435-45aa-b8a3-db8e7dddc678 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.506982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.528586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.529136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.529383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.529676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.533990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5760100-2832-44cc-9555-8fab1d182d47 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.537512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.539043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:07:59.553144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.554280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 257/515] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.555327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.565197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.574691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.575313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.575587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.575859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.576536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.576833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.578240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.590679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 259/516] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.591600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.666621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79299041-ecd7-4e6e-8e8d-8c0370b0712d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.696756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c99fa-f5d7-45b8-b90f-c42157f46cda None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.706699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.707330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.707606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.707909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.709412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.709720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.711444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.726187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 258/517] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.727145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.738240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.738862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.739130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.739397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.740056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.741529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.765625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 260/518] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:07:59 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:07:59.766862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.788699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.828659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.874341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411a25-f26a-48eb-899d-2d174b13c500 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.898787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8f8-8728-4ed4-8919-98cf8ddeed44 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:59.925009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.925009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.925009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.925009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.937875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.939349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.941801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:59.942435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.942976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.942976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.944320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:07:59.944320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:59.945572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:07:59.956336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:07:59.957401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:07:59.958272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:07:59.958272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:07:59.958272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:07:59.958272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 259/519] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:07:59.958486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.972662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 261/520] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:07:59.973784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.080307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.099357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1981-02bc-4813-898c-5ff4a10d7349 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.111277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a5051-608a-4bb5-bcac-acd798cb5a04 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.113171 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.141358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.142011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.142286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.142549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.151790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.152118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.152742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.152897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.153169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.153597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.162601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.164085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:00.167494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.168702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 260/521] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.169547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:00.181761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.183307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 262/522] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.185322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.301484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aec6d-b335-4462-a7da-930becf30aed None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.303635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3da4-7998-4d90-ade2-68a5b27c7569 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.343263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.343912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.344185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.344315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.344520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.344944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.345140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.345314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.345478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.345567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.346945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.361483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 261/523] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.362388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.379874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.387399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.435981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.437946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.492156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faa652-e7b2-40fa-b446-2dfa02cee907 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.538773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.539506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.539784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.540045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.540787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.541092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.542805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.562051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 262/524] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.562898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.577316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 263/525] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:00.578543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.639228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.646473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.679941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce803bd-c2ef-402e-80e5-5305bc39495d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.694375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe76cd1-a8bd-408b-bcc6-6247427dedd8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.724031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.724705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.724969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.725238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.725962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.726258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.727710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.732748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.733486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.733762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.734027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.741291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.742769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.747697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 263/526] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.749333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:00.756310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.757359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:00.758213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 264/527] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.758695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.877173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2966a-e84c-4527-ad35-65f1c07518a9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.879381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760811a-ff31-40dc-9384-74cd69936c80 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.905791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.908637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.916617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.917462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.917802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.918111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.918804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=3f7eb4d9e0f94dd98f3ac4790c63e540) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:00.919162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.920604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.921109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.921769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.922049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.922324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.937451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 264/528] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/role_assignments?user.id=3f7eb4d9e0f94dd98f3ac4790c63e540&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:00.937451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:00.943187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.944739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:00.967759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:00.968785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:00.969643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:00.969643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:00.969643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:00.970295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 265/529] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:00.971450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.068439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b153ce-3d88-4f3e-adc3-1cf5c8e410d7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.109327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.110095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.110627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.110988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.125619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6ff82-ab86-4add-9742-e1412f00b606 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.171455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.172328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.173272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.173701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.174572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.175370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.177305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.193320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.204935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 266/530] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.206143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.213409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.215475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.246443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.319045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9e5b6-0910-46dc-8420-28d65eb97841 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.338875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 265/531] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:01.340011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.362090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.363091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.363091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.363540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.364347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.364770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.366262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.385551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 267/532] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.386567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.454310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.471954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6449f-47a4-4f71-9a11-8a8dc964ff8c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.504708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.513720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd054-c9e6-497e-84ff-25c10ab7b269 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.522002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.523318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.523773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.524209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.525519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.526309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.528774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.536272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 266/533] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.538006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.558714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.559462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.559812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.560147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.579443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.581310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:01.600986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:01.601992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:01.603139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:01.603139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:01.603139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:01.603139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 268/534] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:01.611407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.677295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f86c4-9c70-4838-a4d6-45c64c6aa336 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.758951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.759512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.759783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.760048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.778528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.779996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:01.793510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:01.794584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:01.795731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 267/535] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:01.801029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:01.834442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:01.854367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca82887-df02-4c12-a3e4-2317a8e26b08 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:01.952360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:01.953106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:01.953394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:01.953665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:01.954372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:01.954672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:01.957004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:01.989286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 269/536] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:01.991199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.002687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434211ac-df34-476b-9a26-d4a27bbb8f15 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.003209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.074287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.075141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.075621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.076088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.076990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.077443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.079090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a1aa-b0b7-4937-ae05-c09d57145e14 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.092938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 268/537] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:02.094522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e26bb-6d6b-4346-8950-f0b8e2452e97 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.094947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e26bb-6d6b-4346-8950-f0b8e2452e97 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.095356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e26bb-6d6b-4346-8950-f0b8e2452e97 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.097076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 269/538] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:02.098111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e26bb-6d6b-4346-8950-f0b8e2452e97 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.155022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c503d-6085-431f-8b2e-39d579728d7a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.183009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.208284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.209506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.210159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.210524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.212763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e26bb-6d6b-4346-8950-f0b8e2452e97 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.219545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.221224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2652cf74-8953-47a3-b8a8-ec21a37f638a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:02.237769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.238685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:02.239526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:02.239937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 270/539] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.241461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.241745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.242300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.251796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.252532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.252878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.253214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.254014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=98ae38cdd87144379c63a95dfa9bb9e6) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.254393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.255947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.263917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 270/540] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/role_assignments?user.id=98ae38cdd87144379c63a95dfa9bb9e6&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:02.265037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.265719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:02.267253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:02.405103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.416957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 271/541] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:02.457223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aca82-6c90-4863-be30-df21d51ac8e7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.496216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.497183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.497641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.498076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.498937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.499403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.501047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.508634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.515155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 271/542] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:02.525648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.677282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d55fdd-71e6-4b03-8f66-fbf38c698f6b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.705702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:02.743613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.744260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.744561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.744830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.745733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=6c3846eb00ef4876952addbc1b1d1902) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:02.746040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:02.747511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:02.761626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 272/543] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/role_assignments?user.id=6c3846eb00ef4876952addbc1b1d1902&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:02.865126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988752c-8bd1-4f24-ba5a-f332f6cd0a5c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:02.918735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:02.919470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.919793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.920056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.934756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-93b9685f-c813-40fe-ac0c-37689ee29de0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:02.940035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:02.940968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:02.941772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 272/544] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:02.947301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.028332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.076155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef83bf-c31a-4093-8390-ab4c1625f81e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.124362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.125295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.125782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.126227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.127407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:03.127943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.130537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.149050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119c53-b148-4bca-8c1d-e190778a249c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.149570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119c53-b148-4bca-8c1d-e190778a249c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.149798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119c53-b148-4bca-8c1d-e190778a249c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.151477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 273/545] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.153976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 273/546] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:03.159347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.163149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.163546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.163909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.193731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:03.196583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:03.318950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611d2a-9f43-460b-8b41-883bc134b77d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.349395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.356803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.375561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121103-6717-4951-8336-28fb23568409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.376692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121103-6717-4951-8336-28fb23568409 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.376992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121103-6717-4951-8336-28fb23568409 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.377460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121103-6717-4951-8336-28fb23568409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.404688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 274/547] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:08:03.411539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f121103-6717-4951-8336-28fb23568409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.422543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f121103-6717-4951-8336-28fb23568409 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-1f121103-6717-4951-8336-28fb23568409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:03.454161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:03.455169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:03.456025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:03.456025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:03.456025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:03.456638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 274/548] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:03.462769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.581258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a04c1d-69ef-4442-b9a3-ee0fe8890177 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.622541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.623234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.623617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.623929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.624736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:03.625199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.626808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.642536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 275/549] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:03.649678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121103-6717-4951-8336-28fb23568409 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.717925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.782426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.838587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121103-6717-4951-8336-28fb23568409 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.849025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04420207-f534-49ec-be2c-a0c62c2a279c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.882775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.883849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.884408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.884698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.895576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.897081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.897233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.898075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.898485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.899052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.911958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5fca44ec-80e5-43e8-ac24-3295207fa8f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:03.912156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:03.913101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:03.914014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 275/550] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:03.915427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f283bf-7915-4037-87b5-582226cbe97c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.915427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f283bf-7915-4037-87b5-582226cbe97c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.915427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f283bf-7915-4037-87b5-582226cbe97c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-86578116-6bb9-40c5-a31a-fac7e396612c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:03.920445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:03.922660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:03.924530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:03.925968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 276/551] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:03.925968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f283bf-7915-4037-87b5-582226cbe97c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.926228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 276/552] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:03.926228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.926228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.926228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.953107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:03.954344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:03.986981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.072563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 277/553] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:04.072563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.110480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f283bf-7915-4037-87b5-582226cbe97c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.148193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.148891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.149168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.149434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.150223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:04.150545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.152512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.158238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.173032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 277/554] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:04.179190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.273132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e56e-e0c3-4c8f-a83f-324b1d03ab80 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.307237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.312658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.313278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.313547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.313809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.314481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:04.314780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.316148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.318126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82665-afad-42cb-8871-7adbe421be2b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.325558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 278/555] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:04.330922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.354508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.355319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.355594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.355929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.429333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.430888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.502350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.509145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c695-7261-4f23-ad55-cec2836de9b7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.528749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.543975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 278/556] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:04.544977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.556086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.556763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.557043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.557542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.569697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.572801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:04.587877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:04.589754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:04.590939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:04.590939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:04.590939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:04.590939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 279/557] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:04.590939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.673727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60335c76-70b1-4bc5-97f1-af2e4d4784f9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.715130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.715395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abcf4-0a4d-427d-b546-9245779b270f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.716314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.716831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.717288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.729560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:04.735396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:04.736858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:04.737701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:04.745204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 279/558] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:04.746587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.754476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.755198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.755560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.755888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.768057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.770076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:04.786622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:04.787658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:04.788772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:04.788772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:04.788772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:04.788772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 280/559] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:04.789012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.794222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.816288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:04.871673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4396ae-77c5-4240-87f8-9bbf21480aeb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.907182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddd107-afc3-46a9-b61f-b799e93cb8e3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:04.910966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.911499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.911790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.912063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.912756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:04.913063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.914452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.927464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 280/560] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:04.928742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:04.946700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:04.947620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.948085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.948373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.949154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:04.949464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:04.950872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864bd8a-b364-4fff-a9e7-12b00463d702 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:04.959980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 281/561] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:04.961353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d96c-bae9-4eb7-a1a3-16b6f57b67e0 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:04.961625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d96c-bae9-4eb7-a1a3-16b6f57b67e0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:04.961892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d96c-bae9-4eb7-a1a3-16b6f57b67e0 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:04.967628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 282/562] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:04.968585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4d96c-bae9-4eb7-a1a3-16b6f57b67e0 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.059831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.082897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676a9f-ce03-41cd-854e-d7367516cb63 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.097744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.114381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4d96c-bae9-4eb7-a1a3-16b6f57b67e0 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.122256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.123031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.123317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.123543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.124242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.124582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.126024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.144299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 281/563] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:05.144299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.175419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.176476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.176965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.177433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.191668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.193349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-fea94bf6-2a0f-453c-98be-a6467ea2d004 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:05.206832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.207862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 283/564] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.209500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.210183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.210183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.229183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:05.230479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:05.304067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 284/565] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:05.305043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.306371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6bef-337c-4f02-b6b7-4e100424e8ab None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.376576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.377728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.378196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.378675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.380494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.397532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.400259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:05.427625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.428717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:05.429688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:05.429688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:05.429688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:05.429688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 282/566] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.430870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.449224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03890489-fef6-41b8-a663-cdd28dfbe579 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.475077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.488258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.489072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.489436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.489765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.497381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.498966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7eec9d71-dfe4-4c95-a982-dbbd27a1f8b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:05.511373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.512914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:05.514008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:05.518901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 285/567] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.520267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f974-510a-414c-8778-72779d0b3b38 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.520568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f974-510a-414c-8778-72779d0b3b38 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.520894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f974-510a-414c-8778-72779d0b3b38 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.522258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 286/568] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:05.522855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3f974-510a-414c-8778-72779d0b3b38 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.605000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9214a-b51d-4e06-8db4-1942c34d9ed7 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.649159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3f974-510a-414c-8778-72779d0b3b38 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.667116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.667904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.668442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.668442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.669313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.669682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.670846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.671391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.696131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 283/569] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:05.696131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.696484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.696484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.696484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.696484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.696827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.696827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.696827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4fd6b-576d-41b1-824b-8668f38441d5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.710395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 287/570] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:05.711690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.711972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.712234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.732282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:05.733536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:05.790241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.806322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 288/571] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:05.807171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.809042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e184-a6e2-4e11-9f0d-4abce97c4512 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.850440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.851081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.851354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.851618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.852303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:05.852632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:05.854068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:05.866807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 284/572] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:05.867507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:05.923497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab020f-dbdc-4207-a79b-479bce0e39b8 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.933409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.967890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:05.968919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.969568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.969568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.984385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9ace-0eb1-4169-9b4a-05f5f15ef1df None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:05.984527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:05.988642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:05.989588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:05.990528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 289/573] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:05.991254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.033597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.034234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.034507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.034773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.048705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.050225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.052659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:06.069113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.081230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:06.082404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:06.082404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:06.082404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:06.082404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 285/574] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.082404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.127137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62bd69-773e-4bc4-a7d3-4139245a129c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.163201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.163833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.164110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.164912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.176762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.178368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:06.191315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.192566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:06.193774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:06.194338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49974c89-67a7-49f1-a054-df9bf32268d4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.194768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 290/575] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.194768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.224599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.233481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.234092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.234372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.234639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.235363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=4d2583f38c13417887002a80c64654bd) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:06.235668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.237153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.243191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 286/576] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/role_assignments?user.id=4d2583f38c13417887002a80c64654bd&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.243894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.319965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.332740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c871-a407-49b3-9ac9-4e6fd19e0748 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.377211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.379311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.380056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.380718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.382303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:06.383460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.385831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc42f26-7cf9-4f09-9282-8137d47db359 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.387241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.403427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 291/577] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.404317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.443913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.444499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.444788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.445062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.445724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:06.446028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.447445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.461955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 287/578] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.462846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.538141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.553651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53887681-5345-4780-9701-93f2cdcb3c4a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.596357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf7131-a406-48af-876a-814162499c4d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.600999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.601659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.601926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.602208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.616984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:06.617936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:06.624135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.625421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 292/579] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.626493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.647395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.648031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.648325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.649001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.649371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:06.649678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.651160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.677264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 288/580] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:06.677264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.761347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbadf74-a6fd-4522-921d-10471eac9e60 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.800988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c464-9275-4e6b-84a0-ff5399d06b7f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.805203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.806222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.806671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.807010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.826641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.828112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.838539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:06.846786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.850862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:06.851750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:06.851750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:06.851750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:06.852880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 293/581] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.853748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.854213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.855009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.855481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.855767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.863735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.865209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:06.880917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:06.882104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:06.883101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 289/582] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:06.884075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.945388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.998064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14891f9b-bd1b-48a5-b39e-05e6be69fdbc None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.037587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.038462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.038896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.039809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.040688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.040981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.042486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.053468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 294/583] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.054357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.060841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30ea6f-4340-475a-97ce-b8a263f71949 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.105714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.106393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.106674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.106952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.120581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.122673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.135071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:07.139575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.145594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:07.146805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:07.146805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.146805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:07.146805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 290/584] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.146805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.189097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d8ce-b15b-4257-a7d5-3186a34236c1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.229018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.229642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.230035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.230465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.231193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.231499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.233042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.244810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.246788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 295/585] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.247672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.265362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d1ec-bcab-4851-a1d5-6d926dab51fc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.305893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.306530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.306804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.307162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.307962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.308672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.309996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.324638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 291/586] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.325550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.372939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdb5d-b3b5-44c0-be60-6f0d6f6b513b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.398386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.413316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.413971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.414245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.414512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.426224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.427731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:07.443069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.444047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:07.445012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:07.445012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:07.445012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:07.445012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 296/587] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.445012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.453080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172e81e-c118-427a-aecc-b5ccca1a4428 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.490906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.492047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.492619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.493097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.493826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.494198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.495871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.513107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 292/588] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.513107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.520518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.581229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631b459-83fb-41eb-a5bc-132817a2f0b0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.620445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.621392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.621852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.622123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.626734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558433-ecca-428c-9d3c-7ca9d815fc2b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.630475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.631929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:07.643957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.645044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 297/589] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.646651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.674090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.674765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.675044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.675314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/3f7eb4d9e0f94dd98f3ac4790c63e540/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.687643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.693549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=3f7eb4d9e0f94dd98f3ac4790c63e540, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.695054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.718759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 293/590] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:07 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/3f7eb4d9e0f94dd98f3ac4790c63e540/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:07.728669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.806454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27891a-4a68-49c0-b5c2-bb6f2eb37d0c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.809961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:07.865233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.865694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d45fd7-202d-4caa-aa15-3a69e53b523a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:07.865831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.866111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.866382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.867100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:07.867407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.870303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.893851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 298/591] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:07.894131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:07.908300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:07.908973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:07.909251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:07.909640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:07.917407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:07.919401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:07.932203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:07.933226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:07.934106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 294/592] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:07.934917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.021807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.030839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0395-38d1-4fad-bbc2-2849da270066 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.065231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb17fa-e1ff-47a8-ac37-cb34a0e1490b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.074518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.075124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.075457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.075924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.077227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.077227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.078877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.088819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.106832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 299/593] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.106832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.115653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.116219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.116527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.116798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.128703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.130917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:08.147847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.153341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 295/594] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.158539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.249671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eee79-e546-43f4-be6b-aec7397683b9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.277496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedb26-d1fc-44f2-835a-54a06a36e517 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.292553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.293181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.293575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.293832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.294531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.294823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.296771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.312457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 300/595] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.312457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.325099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.325513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.325786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.326057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.326967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.338287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.339834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c96073db-b682-4302-87d5-15c3d399ec43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:08.355294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:08.356532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:08.357707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:08.357707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:08.357707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:08.357707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:08.359955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206934-bd04-4421-898c-81846aa301fb None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.360495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206934-bd04-4421-898c-81846aa301fb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.361361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9206934-bd04-4421-898c-81846aa301fb None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.363166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 297/597] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:08.364274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9206934-bd04-4421-898c-81846aa301fb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.401790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.439234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768bd73-d360-48e9-aa4d-1d71e4f4bc9e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.504036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.505129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.505478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.505962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.507165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.507452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9206934-bd04-4421-898c-81846aa301fb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.507693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.510111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.536863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 301/598] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.537831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.564205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.565026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.565309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.565587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.584345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=2512318b0a854bd2934befc3de218102, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.586115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901375-3929-4327-93bb-518908f1d731 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.604532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 298/599] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:08 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:08.606286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.606648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.607035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.632884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:08.634148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:08.649286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.702183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195355-ed17-46fe-a215-1adf87eacc31 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.735564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 299/600] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:08.737058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.752922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.753545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.753816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.754079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.755133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.756049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:08.756295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.759111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.780434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 302/601] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:08.784711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:08.918403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f68ef-dbb1-4afc-a139-5e07525bf99c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.939062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e16b-3a9e-4b78-9394-2a214161ecc6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:08.968632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:08.970023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.970673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.971122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.985520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:08.987244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:08.995356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.008087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.009378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.009978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.010571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:09.012739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.013834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:09.014869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:09.014869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:09.014869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:09.016750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 300/602] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.025618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.039468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.041301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:09.065939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.067183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:09.068184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:09.071176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 303/603] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.083995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.134846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.197740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc525-b8c5-443b-89a1-409ecd5f38a4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.245123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda3bd6-6166-41b9-a857-960830f0ed77 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.263613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.264815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.265408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.265895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.267036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.267578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.270329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.287689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 301/604] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:09.288718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.292907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.294025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.294467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.294941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.296700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.297224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.299952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.326534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 304/605] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.328246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.407502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.426207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35a3d-d373-4ee0-bc82-0809043a9510 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.456221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.472945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.473591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.473867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.474133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.479865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2275f-ea87-4946-af9e-98f8d3266d80 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.490028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:09.495046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.496238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:09.497451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:09.498236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 302/606] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.499341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.536116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.537294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.538036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.538595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.548408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.550651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:09.566374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:09.567471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:09.568519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:09.571288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 305/607] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:09.572550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.638500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ddeb-845a-4a48-8061-74e80e53b89e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.690573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.692707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.693675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.694296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/98ae38cdd87144379c63a95dfa9bb9e6/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.731055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=98ae38cdd87144379c63a95dfa9bb9e6, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.735293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.743192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1108f5-dc7a-4694-a6d6-7d4ee9388e03 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.760286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.769090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 303/608] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:09 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/98ae38cdd87144379c63a95dfa9bb9e6/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:09.771242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.826653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.828929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.829319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.829464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.832412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:09.832752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.836336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.858234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 306/609] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:09.861690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.863969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.976937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74ef1a-fafd-47ff-b717-4dfed3163ff9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.021038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.021575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.021859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.022136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.023313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:10.023624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.025520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.041678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 304/610] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:10.053549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.063762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4421ee-d327-42aa-bf9a-b9c1a1134df2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.105331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.106544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.107139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.107755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.120682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.122498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-518d70ce-fe31-4aab-bbd2-818b2c7af050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:10.139125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.140151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:10.141080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:10.141080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:10.141080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:10.143209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 307/611] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.144710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe9a7-574e-419c-89e8-3dd1c9cb1792 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.145207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe9a7-574e-419c-89e8-3dd1c9cb1792 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.145676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe9a7-574e-419c-89e8-3dd1c9cb1792 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.147380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 308/612] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:10.154239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.154551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.157708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.176281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.182324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:10.185465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:10.190704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ec2b6-7f3c-43ec-9bf3-a2a4bc2b233a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.207002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.233026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.234006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.234462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.234731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/6c3846eb00ef4876952addbc1b1d1902/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.253462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=6c3846eb00ef4876952addbc1b1d1902, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.255248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.274322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 305/613] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:10 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/6c3846eb00ef4876952addbc1b1d1902/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:10.275559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.288581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 309/614] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:10.458366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66136fdf-1633-4ef9-bfa4-63a691c4deec None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.510971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.512314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.512932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.513387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.514273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:10.514785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.516560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.536737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 306/615] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:10.543003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.685744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580e124-4ab8-44d4-86d1-b5ade03cc58d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.694413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.700199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.734716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.735601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.736001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.736446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.745780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:10.747911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:10.761666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.763039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:10.764059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:10.766730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 310/616] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.773904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.811882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:10.860426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6b8b-c0cc-461b-b39f-8283d7dd7dcc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:10.900879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:10.902026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:10.903257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:10.903647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:10.915144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:10.921689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:10.922947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:10.923828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:10.929715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 307/617] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:10.932736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:10.964629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3fa37-868f-4996-a723-f917fedd2652 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.004986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.005813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.006183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.006544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.007518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.007924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.009573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.031535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 311/618] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.038767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.068412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.121403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abb346-cbf2-47d9-ba14-3d9468a580ea None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.172159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.173143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.174520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.174976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.177466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.177945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.179489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.199502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 308/619] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.205340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.235501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.309235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68eacf-c7d9-48c8-87b3-485887fd4f8b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.366121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.366997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.367373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.367737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.376898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca24495-46c6-45a3-9a9c-a035cd87bc57 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.382680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.384278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-8eae0583-b153-4fc6-8bbf-0a07f26694fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:11.406604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.407665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:11.409101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:11.409101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.409101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:11.409478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.409577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 312/620] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.410701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277378ed-6aee-4d75-a184-00b83a7b2a43 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.413854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277378ed-6aee-4d75-a184-00b83a7b2a43 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.413854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277378ed-6aee-4d75-a184-00b83a7b2a43 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.413854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 313/621] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:11.415667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277378ed-6aee-4d75-a184-00b83a7b2a43 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.427326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.428000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.429354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.429680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.445460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.447510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2786679f-46eb-4e6d-a8aa-9cf06422e402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:11.466803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.469041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 309/622] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.470619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.494173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:11.495472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:11.562401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277378ed-6aee-4d75-a184-00b83a7b2a43 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.592281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.600048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 310/623] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:11.600048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.615295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.615954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.616285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.616589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.617250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.617550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.619014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.646692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 314/624] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.652364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.802448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32046d1-521a-4202-9277-66db18742dd0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.812436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:11.858289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0e2-d0e8-4c4b-b2fd-1ff6d4cf6440 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:11.874764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.875377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.875656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.875927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.876694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:11.877001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.880023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.906688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 311/625] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:11.913340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:11.930714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:11.931496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:11.931775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:11.932043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:11.940119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:11.941874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:11.955298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:11.956430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 315/626] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:11.957861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.012667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.045197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549e6ff-e9a3-4087-8769-95ebc1138fa0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.082165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e679a5a-86c9-4067-a4b2-8ed9dd716344 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.084203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.085716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.086001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.086270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] PATH_INFO: `/v3/users/glance` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.095657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.097254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:12.110529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:12.111586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 312/627] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:12.112596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.125933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.126493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.126749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.127016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.138596 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a52e0f5c-358e-4743-b8e0-9347a887582b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:12.143823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:12.144840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:12.145715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 316/628] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:12.146439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ffb6-68e3-46d3-8a0b-73e41b3e97dd None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.146439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ffb6-68e3-46d3-8a0b-73e41b3e97dd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.146955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ffb6-68e3-46d3-8a0b-73e41b3e97dd None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.152469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 317/629] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:12.152469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ffb6-68e3-46d3-8a0b-73e41b3e97dd None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.153102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.244826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837542-e2af-4bee-aeee-cc6ea27697ba None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.269141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ffb6-68e3-46d3-8a0b-73e41b3e97dd None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.272961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.284355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.285003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.285281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.285551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.286250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.286555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.288009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.301293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 313/630] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.302180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.314602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.315217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.315490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.315753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.316521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.316820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.318386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4406f32-d5ef-40d3-9ada-6709d6befd52 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.343942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 318/631] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.343942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.343942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.343942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.359482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:12.360690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:12.410310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.427934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e87b3-064d-4e89-9d64-11d80d2470d8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.442292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 319/632] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:12.442292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.476219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.477549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.478047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.478319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.478991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:12.479302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.481114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.494997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 314/633] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:12.496304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.578173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.592888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7dfe1-a6b5-41ce-81a6-a201dabb6cca None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.628873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89cf-5f42-4d5f-9b6e-33481ec9d046 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.643081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.643753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.644053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.644424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/4d2583f38c13417887002a80c64654bd/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.665075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=4d2583f38c13417887002a80c64654bd, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.667461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.674328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.675104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.675541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.675812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.691213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:12 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/4d2583f38c13417887002a80c64654bd/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:12.692356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.714716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.781104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.782636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c09d74-edd5-4862-9c2f-78c1b94541ea None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.831440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e190b37-f28a-438b-a11f-6783654bd48a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:12.881072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:12.882005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.882497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.882701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.895360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:12.897058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:12.899170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:12.907830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 315/635] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:12.909294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2540-9a7f-423d-8061-9a8253b16b60 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:12.909656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2540-9a7f-423d-8061-9a8253b16b60 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:12.912829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2540-9a7f-423d-8061-9a8253b16b60 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:12.919250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 316/636] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:12.919250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a2540-9a7f-423d-8061-9a8253b16b60 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:12.919527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:12.920908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:12.921793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:12.921793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:12.921793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:12.921793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:12.921793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:12.983279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.047362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5095b-581d-484c-9aa9-694cc73546df None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.051550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a2540-9a7f-423d-8061-9a8253b16b60 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.093477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.094126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.094401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.094667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.096996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.098390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.098390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.098390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.110024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:13.110312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.111952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-fff85646-8dbd-48bc-bfe0-b45fb0fe07a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:13.114889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.115938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:13.116991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:13.121224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 317/638] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.122657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571732-f86b-404f-a017-79f0178d218f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.122969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571732-f86b-404f-a017-79f0178d218f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.123249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571732-f86b-404f-a017-79f0178d218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:13.137090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.138163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:13.139106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:13.139106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.139106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:13.139106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 322/639] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.139821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.150684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0d571732-f86b-404f-a017-79f0178d218f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:13.152255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0d571732-f86b-404f-a017-79f0178d218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:13.197116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.248954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 318/640] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:13.250964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d571732-f86b-404f-a017-79f0178d218f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.274505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44824-aed4-4777-afd8-c5835047be48 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.303431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.330314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.331674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.332501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.332954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.334075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.334995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.336991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.357735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 323/641] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.358900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.391642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d571732-f86b-404f-a017-79f0178d218f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.441620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.442555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.443014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.443462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.445270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.445785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.447807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.466210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 319/642] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.466210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.481607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd095-c9d5-41c6-9285-fc550d4dd0b5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.491182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.520917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.521793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.522079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.522328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.522993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:13.523282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.524742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.537732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 324/643] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:13.539552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.620190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.624310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7941c6-c300-4708-b6e6-56f3b1f15f01 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.660540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9927e4e-05c7-4074-b3f6-7d531d28f3c7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.664824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.665526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.665806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.666077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.676621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.678192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:13.690460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.691571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:13.692587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:13.696296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.697301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.703670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.704231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.704533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.704798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.717532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.718070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:13.734259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.735421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:13.736518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:13.736518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:13.736518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:13.736518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.736518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.760300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.828126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bf9db-f093-43af-92b7-af83937a66c6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.879683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.880045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3771-3b84-4d0a-bf83-e43d763ceeff None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:13.880497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.880834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.881162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.892355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:13.897714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.898854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 321/646] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.899711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:13.928077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:13.933144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:13.934102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:13.934376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:13.934640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:13.942633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:13.944118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:13.957179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:13.958186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:13.959080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 326/647] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:13.959614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.042229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ad409-7102-43af-9fad-688bb5695114 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.066683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.086642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.087404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.087645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.087914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.088688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.088996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.090985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.093677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5785-27e0-4ac6-9e5b-f31bc984f1ce None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.115564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 322/648] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.116519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.133959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.134896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.135339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.135990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.136988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.137479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.138890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.151921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 327/649] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.156877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.230771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.262590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097d36-168b-478f-ae9f-367dee514598 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.315431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b019f-e10a-435e-b75f-04bf19827ff2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.316183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.316912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.317291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.317628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.318245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.318551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.319951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.330523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 323/650] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.331345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.365381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.366005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.366266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.366536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.367260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.367540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.369307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.378109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.385364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 328/651] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.391179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.451852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26a70c-06c9-42ad-b855-04a4d8fe082d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.490074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.490712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.490993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.491268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.503504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.504263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84655c21-9e82-4c1c-9e1e-638dc067eb04 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.545070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.545070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.545070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.545070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.557236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.559113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:14.576238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:14.578261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 329/652] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:14.580129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.595544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.597041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.657268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.710744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd2d00-cd8c-4f6e-b668-74260097d814 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.723834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 324/653] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:14.725433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.755899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.756674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.757015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.757311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.769846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.770061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.771581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:14.788569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:14.789622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:14.790890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:14.790890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:14.790890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:14.790890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 330/654] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:14.790890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.837663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1e977-139f-4f00-8208-7e4236c71c08 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.888069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.888724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.889113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.889273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.890008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=3f7eb4d9e0f94dd98f3ac4790c63e540) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.890316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.891776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54a70-47d1-4f8b-bbb4-f0cc1149a1bb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.898384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 325/655] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/role_assignments?user.id=3f7eb4d9e0f94dd98f3ac4790c63e540&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.900036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934249-c019-47d2-afb8-35a16cbfa4ab None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.900036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934249-c019-47d2-afb8-35a16cbfa4ab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.900236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934249-c019-47d2-afb8-35a16cbfa4ab None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.901922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 326/656] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:14.902908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59934249-c019-47d2-afb8-35a16cbfa4ab None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:14.912030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6d4ac-47b9-49f1-82cc-30e15d2a5b63 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:14.926918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:14.957595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:14.958227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:14.958500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:14.958765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:14.959529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:14.959832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:14.961368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:14.986214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 331/657] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:14.991746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.053582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59934249-c019-47d2-afb8-35a16cbfa4ab None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.056696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.105093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.105657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.105937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.106424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.118561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.120063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.120239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3751915-40a7-4e2e-807d-830f58ebfc89 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-bdc29727-82bf-4f36-90db-f20bf7de897d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:15.137499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:15.138553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:15.139493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:15.139493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:15.139493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:15.139493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 327/658] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:15.140641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.141937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.141937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.160729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.161395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.161668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.162000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.162706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:15.162877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:15.162987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.164096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:15.164459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.178411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 332/659] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:15.183394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.213754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.245457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 328/660] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:15.246953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.302135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc723-e04f-426e-8cdb-343dbbdcd5fc None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.343298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.343824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.344109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.344470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.382957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.397017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42588-865f-4651-b41a-3c088c6dae84 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.430726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.432654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.437274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.437903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.438182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.438450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.439110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:15.439413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.440865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.458340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 329/661] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:15.459210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.479759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.597678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 333/662] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:15.599132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.620583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7311c4-f3c7-4716-b3f6-b8d9c5427210 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.672452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.673568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.673849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.674272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.683585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.685125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:15.698286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:15.699313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:08:15.700740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:15.704584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 330/663] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:15.705355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.715470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.733906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08174-2f2f-40fe-b697-4ff309cfccb7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.763714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.773174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.773814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.774050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.774310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.782516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.784067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:15.797489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:15.798748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 334/664] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:15.799663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.828693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa244a-0118-466d-8d1b-6b7bc8338009 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.865857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.866417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.866698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.866972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.878377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:15.883737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:15.885020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:15.885864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 331/665] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:15.886718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:15.916160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddeffc-c244-4f7a-accd-3cc17ea37679 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:15.955956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:15.956675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:15.956965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:15.957127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:15.969691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:15.971197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:15.973690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:15.996744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:15.998584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:15.999747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:15.999747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:15.999747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:15.999747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 335/666] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:16.000156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.024090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154dc56-3374-4de6-b323-0f87d03531dd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.066209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.077868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.078932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.079433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.079930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.081314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.081885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.084049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.115316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 332/667] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.115316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.147919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643b09e-9ad6-4117-acfe-f1d9764fa11c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.187953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.188486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.188764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.189029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.189765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.190043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.191487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.211044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 336/668] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.211044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.238839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae89cb0-4a00-4446-b586-832584423c11 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.267653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.281636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.282537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.283016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.283384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.284268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.284727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.286233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.301073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 333/669] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.301073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.322752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.325941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30ccf-16c5-40a1-a003-a9d160b6464f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.363337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.364033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.364362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.364713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.365423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.365779 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.367239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.379574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 337/670] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.380843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.426941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc26d-16e4-41ef-91c3-071750e3dbe5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.477213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.477834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.478114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.478383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.522735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf18d4-2375-4ded-97b0-32a1c90e62f2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.547154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.565917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.566913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.566913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.567086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.567706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:16.568019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.569352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.569540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.570824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.584420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 338/671] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:16.584420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.616147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.719135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96687b5-5fce-4501-9258-cd5c60362ebe None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.735067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 334/672] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:16.736211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.770466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.771463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.771997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.772278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.794183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.795874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:16.815465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:16.816608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:16.817525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:16.817525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:16.817525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:16.817525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 339/673] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:16.818286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:16.875560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.890592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37968f45-ed8f-43af-884f-e69c46557ac8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.917621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:16.935327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:16.935983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:16.936288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:16.936593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:16.944028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:16.945532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:16.948065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a948c9d-6910-4a36-9b4e-7b00fdc5954c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:16.962233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:16.963208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:16.964111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 335/674] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:16.966169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.001118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.001933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.002043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.002294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.014706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.015899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a79e44bd-99eb-463c-bfad-33d6c984cc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:17.032122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.033359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:17.034259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:17.034259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:17.034259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:17.034259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 340/675] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.035439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4146-5a1d-400e-b6a2-011b7f895ca9 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.035439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4146-5a1d-400e-b6a2-011b7f895ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.035439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4146-5a1d-400e-b6a2-011b7f895ca9 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.040737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 341/676] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:17.040737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4146-5a1d-400e-b6a2-011b7f895ca9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.091912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e08a2-3653-4e5d-9349-e51f61bbbbb3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.131433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.132180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.132491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.132764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.133659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.133766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.135155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.149002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 336/677] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.149663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.159502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.167099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4146-5a1d-400e-b6a2-011b7f895ca9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.201003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.211632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.212214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.212581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.212828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.214006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.214006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.215473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f930ae-dce4-460b-ac77-955c877c78bb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.236020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 342/678] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.237502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.237783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.238115 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.257468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:17.259206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:17.271000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fce94-0abe-4836-9f5b-3c37283344ca None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.307798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.308578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.308802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.309070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.309706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.310006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.311388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.323569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 337/679] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.324642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.342031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 343/680] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:17.343519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.407893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.447746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdad40-77e2-4870-ac9f-108b3dbc72c5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.458675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4424d0-9cc8-4351-8871-bbded65a3657 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.478418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.487984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.488692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.489125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.489647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.498841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.500448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.505647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.506858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.507407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.507972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.509254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=98ae38cdd87144379c63a95dfa9bb9e6) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.509851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.512136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:17.513698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.515117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 338/681] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.516818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.524517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 344/682] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/role_assignments?user.id=98ae38cdd87144379c63a95dfa9bb9e6&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.525610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.697301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d763c-9f4b-46b8-b9ba-869dc2649729 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.707164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5719-31c1-4dc1-a727-07d74bd26901 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.745761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.758648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.759296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.759467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.759591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.759833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.760080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.760352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.760664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.761402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:17.761765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.763222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.768285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:17.769800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:17.785348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 345/683] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:17.786206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:17.787206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:17.788111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:17.789067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:17.791478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 339/684] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:17.792599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:17.857975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:17.934610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1738-957e-4f87-a9b0-d7f632df4f11 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.946308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe04d-2612-4f1f-99cc-1c91deec5d9b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:17.992237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.992917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.993191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.993461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:17.993813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:17.994973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:17.995478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:17.996436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.006519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.008052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:18.028351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:18.029798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:18.030959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:18.030959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.030959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:18.030959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 346/685] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:18.031208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.083807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.103286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.104920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.163740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.185509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bb56-ba11-4286-98a5-6fbfc0709cd9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.229223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.229844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.230120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.230513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.231360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.231792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.233430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.249625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 340/686] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:18.250595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.252867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 347/687] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.253941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.372670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.382349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2df2-c2af-4508-ab4d-8906f751493e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.395550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490cbb-cb71-4019-bb48-2ce895cc129b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.429243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.430171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.430781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.431283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.432429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=6c3846eb00ef4876952addbc1b1d1902) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.432935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.434691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.442335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.443365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.443556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.443889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.444796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.445174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.446887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.452940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 348/688] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/role_assignments?user.id=6c3846eb00ef4876952addbc1b1d1902&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.454196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.469213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 341/689] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.481772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.484089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.588488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55b9c-386b-453f-8fad-e0b8f656a255 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.630633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.631707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.632160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.632631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.645047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.646979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:18.665961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:18.666978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:18.667993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:18.667993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:18.667993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:18.670567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 349/690] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:18.677556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:18.724579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29940589-e1a2-49db-98c0-5ff4ca2644d0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.774415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.775042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.775322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.775595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.776283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.778780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09878c-d3c5-4afe-a0ff-f67a414c272d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.801141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.816722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 342/691] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:08:18 2022] POST /identity/v3/users => generated 254 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:18.866624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa714577-bfa9-41e9-8246-153e072e4728 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:18.890732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8dde1-d6f0-4955-9cd6-0c8401fd9c9a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.891105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8dde1-d6f0-4955-9cd6-0c8401fd9c9a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.891262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8dde1-d6f0-4955-9cd6-0c8401fd9c9a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.893537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 343/692] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:18.899841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.900151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.900445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.919778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:18.936134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:18.937896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:18.938587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:18.939266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:18.940625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:18.941402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:18.944211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:18.946825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:18.948721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:18.970272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 350/693] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:18.982258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.114688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 344/694] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:19.140098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14906cc-975e-4aca-99b9-a98518a550c7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.171814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.180879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.181569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.181840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.182101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.190029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.191637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:19.204186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:19.205160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:19.206067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 351/695] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:19.211709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.347390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f081e-71fc-4ad3-8c0e-8421937c10a7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.384214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.390573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.391678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.392244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.393723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.394509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:19.394843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.396311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.410461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 345/696] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:19.417292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.453269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.580372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b89f9-e4fb-4934-b02c-80b6b8a19ece None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.591397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94751c6-ad5b-4397-8088-10d3544d3638 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:19.636556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.637652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.638314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.638886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.654996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:19.665260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:19.665486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:19.665706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:19.668414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:19.668414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=4d2583f38c13417887002a80c64654bd) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:19.668414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:19.670865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d61b-04e8-41f8-a504-db2cb188a0a3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:19.674715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:19.675666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:19.676536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:19.677185 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 346/697] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:19.688431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:19.695008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 352/698] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/role_assignments?user.id=4d2583f38c13417887002a80c64654bd&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:19.878889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.018819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364639-ecf9-4695-b655-b64a3ebf2768 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.095848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.096698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.097126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.097550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.099010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:20.099484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.102158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce96d86-befe-4942-bdda-19b12c62db58 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.112537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba5929-16c8-4922-8a38-7f73f5d34e65 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.113500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba5929-16c8-4922-8a38-7f73f5d34e65 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.113965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba5929-16c8-4922-8a38-7f73f5d34e65 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.115498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 353/699] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:20.119889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 347/700] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:20.125995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba5929-16c8-4922-8a38-7f73f5d34e65 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.132183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.137667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.138138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.165605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:20.167354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:20.261113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.299772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 348/701] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:20.370498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba5929-16c8-4922-8a38-7f73f5d34e65 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.422549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.423235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.423513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.423776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.443238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.444743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:20.462654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:20.463664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:20.465878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:20.465878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:20.465878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:20.465878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 354/702] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:20.471228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.562514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:20.652673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03215f-3f02-4348-a922-ee75e6f12d73 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.709240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:20.711005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:20.711982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:20.716854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:20.722362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:20.723449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:20.727275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:20.754251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 349/703] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:20.765800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.806435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:20.921614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2edfa7-9d5a-4bff-8757-1ff651e8f174 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:20.924492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.011349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.012059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.012333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.012737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.024515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.028440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:21.045237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:21.048019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:21.049962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 355/704] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:21.053966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.098343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc3532-5dd1-47bc-acc3-2afa9efad492 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.105894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.176370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553d23-fbcf-44ed-80c3-d56969336162 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.192928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.193688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.193923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.194195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.194842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.196231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.218326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.219301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.219793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.220258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.221275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.221796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:21.222714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:21.223784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:21.224729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:21.227277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.231850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 350/705] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:21.237537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.252953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 356/706] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:21.261676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.314190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.368736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b5d1-a2ac-46b1-8573-b66e894db0b9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.443671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3bc9e-73e3-4111-b635-934d160bda35 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.461960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.462521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.462810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.463085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.463724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.464027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.466486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.487262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 351/707] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:21.491811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.492871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:21.493589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.494310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.494894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.589324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.658184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.659682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb698374-b183-4166-a6ff-81d49f394032 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.709644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:21.737114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec8206-c174-4f17-ad8e-c1d5bd3aa5ea None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:21.792577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:21.793413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.793855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.794323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.795080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:21.795536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:21.796756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74e554-1883-4da2-b1e3-984b00a444f3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:21.803070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 352/708] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:21.804384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427c65-18af-480c-af22-af5eb2d88f14 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.804696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427c65-18af-480c-af22-af5eb2d88f14 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.804965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427c65-18af-480c-af22-af5eb2d88f14 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.812447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 353/709] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:21.812447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c9bb-aec7-4ab6-bdb7-885827849732 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.812447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c9bb-aec7-4ab6-bdb7-885827849732 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.812447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c9bb-aec7-4ab6-bdb7-885827849732 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.812447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 354/710] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:21.818356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.819324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.820027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.849092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:21.850648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:21.852615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 357/711] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:21.856885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:21.857337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:21.857782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:21.890236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:21.891696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:21.961086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 355/712] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:08:21.962218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.006415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.031450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 358/713] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:22.105411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cececb9-345d-4378-8b94-bbf29df294dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.148899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.149824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.150246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.150657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.163962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.165767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:22.182861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:22.184264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:22.185325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:22.185325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:22.185325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:22.187218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 356/714] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:22.196764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.278440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.339257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.349041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41ad12-8d9c-421d-8df9-8d0683fd7e72 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.414215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.415206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.415673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.416130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.417022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:22.417552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.419598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.432606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 359/715] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:22.433986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.524832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.549694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2011a9-8dde-4433-b1fe-625c79794901 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.578597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8dcf5-9f77-493d-8357-c9d613732425 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.596357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.623062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.623277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.623731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.624017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.624293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] PATH_INFO: `/v3/services/network` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.624937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.625173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.625647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.626101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.626371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:22.637765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:22.638860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:22.640364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 357/716] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:22.641190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.643611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:22.649866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:22.650893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:22.651781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:22.661196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 360/717] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:22.662628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.762342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4024b-459d-4faa-bceb-dc5b9723a46a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.784173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8303e0-b517-45ac-bc71-bec523177f0c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:22.803303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.803880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.804163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.804486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.812872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.814583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:22.828768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:22.829749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:22.830637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:22.832971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:22.833568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 358/718] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:22.834297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.834588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.835226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.835702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.836711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] RBAC: Adding query filter params (name=network) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:22.837163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:22.837791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:22.839771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0773a0c-30bf-4729-914f-b237c218f261 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:22.845679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 361/719] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:22.847298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda608c5-13a9-4fbf-aa97-675d14f79295 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:22.847642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda608c5-13a9-4fbf-aa97-675d14f79295 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:22.847971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda608c5-13a9-4fbf-aa97-675d14f79295 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:22.849771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 362/720] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:22.850789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda608c5-13a9-4fbf-aa97-675d14f79295 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:22.902790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.015540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc546222-63a0-4d2e-beb6-ecd35ecd9899 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.032376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda608c5-13a9-4fbf-aa97-675d14f79295 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.080627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.081835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.082274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.082756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.083904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.084283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.086179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.094389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.095354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.095716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.096133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.097110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.097570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.099225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 359/721] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.099495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b634-0c5a-4bc3-8cae-7c1623f23bcc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.100608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.125643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 363/722] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.127427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.127753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.128096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.153159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:23.154655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:23.210125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.240713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 364/723] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:23.249778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.257857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61505-5213-4afa-8397-64322b264a7c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.292180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.310043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.311058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.311516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.312061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.313021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] RBAC: Adding query filter params (type=network) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.313526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.315291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.322183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 360/724] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.323467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.439560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35d3b0-ce30-4f36-a09d-60a0e11789f1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.486388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f976d0-0a17-4b65-b548-cd0be7f5b17a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.500753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.501502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.501781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.502053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.519349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.521162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.526040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.540939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.542461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.543245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.543988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.545642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.546632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.549741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:23.550192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.551847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:23.553496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:23.553496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:23.553496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:23.555210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 365/725] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:23.556297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.565885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 361/726] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.567684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.734405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:23.774629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ba85-570a-4928-ba51-b6e9e2ea7b1f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.832317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59a73-74e9-415b-b4b7-ce1d6b2572c3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:23.845827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.847882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.848419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.848880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.874623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:23.881071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:23.882229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:23.883454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:23.886413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 366/727] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:23.895197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:23.900444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:23.900444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:23.900444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:23.902436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:23.903853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:23.904443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:23.907202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:23.955984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 362/728] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:23.971945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.058445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.130928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bfaf9-7edc-4dc2-934c-eef9fe81292f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.213345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7835-b35a-477a-a54d-9b4f17fab484 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.217487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.219280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.220031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.220744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.234742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.237642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:24.267965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:24.269608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:24.271206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:24.285895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 363/729] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:24.294134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.308424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.308424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.308424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.309514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.309514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.309514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.311619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.324472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 367/730] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.325271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.327694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.550949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f308-0484-4f71-af53-2e39d50b6da1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.559783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6782-5293-4994-8740-184215a756f1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.580909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.593849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.595334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.595799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.596517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.602748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.603490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.603864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.604228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.605101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.605500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.607301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a9ec6-22d5-4e84-a887-927b77afe4a6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.613570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.615317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:24.636797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:24.637942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:24.638888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:24.638888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:24.638888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:24.639445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 364/731] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:24.641037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 368/732] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:24.641404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73b5bb-b739-47b5-92b9-3711fe54a2f5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.641892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73b5bb-b739-47b5-92b9-3711fe54a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.642260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73b5bb-b739-47b5-92b9-3711fe54a2f5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.642918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.644425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 365/733] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:24.646922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73b5bb-b739-47b5-92b9-3711fe54a2f5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:24.722778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:24.791932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977aac44-ccf9-4b6b-8a9d-bcb6c0925719 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.805927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73b5bb-b739-47b5-92b9-3711fe54a2f5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:24.837342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.837972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.838253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.838522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.877996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:24.879633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.880380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.881228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.882895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:24.883727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.886835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53fc34-deee-43ac-9e19-635d65e92795 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.910823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 366/734] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:24.913707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:24.914577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:24.915331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:24.927684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:24.930272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:24.948351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:24.952039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:25.003215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.030843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.069771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 367/735] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:25.071156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.146042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 369/736] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:25.156919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.283780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efb9d-5b4d-4b31-b30a-358861cbe64a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.324742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.325770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.326280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.326759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.335688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.337547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:25.351503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:25.352575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:25.353796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:25.356556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 368/737] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:25.365478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.393560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.430408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0705e4-d292-4671-a6db-fb4c3fca4d65 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.489851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.490521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.490801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.491065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.516435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.516435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.519898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc58c5-e088-44ef-bf03-262589aaa0c1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:25.532888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:25.534120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:25.535272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:25.535272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:25.535272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:25.535272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 370/738] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:25.542127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.555793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.582046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.583296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.583720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.584427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.585737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:25.586201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.587809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.608763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 369/739] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:25.609927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.690868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9c04-0e52-4b6a-ae4c-3b584cdc1df1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.700362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.734558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bef2d3-d521-4fe9-abff-ea178092f756 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:25.746855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.747914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.748357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.748933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.750151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:25.750339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.751883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.777136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 371/740] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:25.779239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.786237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:25.787133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:25.787559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:25.788033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:25.788904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:25.790629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:25.813208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 370/741] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:25 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:25.814448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:25.927566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:25.969759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd719c35-5e22-481a-a29a-bf7e2dc00831 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.009419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052127cc-da98-444b-9455-9b49a7da287b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.030903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.032255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.032981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.033386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.036158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.044150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.046795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5e284935-6349-4e87-a4ad-67f2b5ae5dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:26.069265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.070338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:26.071309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:26.071823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 371/742] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:26.074096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7102f3-5986-40e5-acc0-9cc54206b86d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.074483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7102f3-5986-40e5-acc0-9cc54206b86d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.075143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7102f3-5986-40e5-acc0-9cc54206b86d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.083166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 372/743] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:26.083166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7102f3-5986-40e5-acc0-9cc54206b86d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.101737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.102860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.103385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.103828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.228698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.229689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.238790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7102f3-5986-40e5-acc0-9cc54206b86d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.287801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.288509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.288859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.289224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.290019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.290398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.292730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460d3a-aebb-46fe-b2fc-727461f07cbe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.307723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 373/744] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.309871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.310219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.310581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.323913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.336492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:26.339113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:26.378001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 372/745] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:25 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:08:26.379719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.423830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.466882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 374/746] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:08:26.468799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.568987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523d714-3a96-41d4-b03a-8740f9f01b2e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.635533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.636242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.636641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.636926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.637293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4af9-82cf-4808-b80b-c96851d5daff None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:26.637923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=e6160c9f7ca04f579b99202118032eef) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:26.638333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.639871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046a925-d58d-477c-8e82-d1044fdf4f89 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.647217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 373/747] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/role_assignments?user.id=e6160c9f7ca04f579b99202118032eef&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:26.649031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa799-5f41-4a3f-9172-f74ffb7fc1f2 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.649344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa799-5f41-4a3f-9172-f74ffb7fc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.649615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa799-5f41-4a3f-9172-f74ffb7fc1f2 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.651399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 374/748] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:26.661799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.662071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.662418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.713265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:26.714229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:26.714650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:26.715051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:26.717667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:26.719067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:26.737073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:26.740602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:26.774447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:26.778147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:26.781284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:26.781284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:26.781284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:26.781284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 375/749] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:26.788456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:26.796355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.854489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:26.874871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 375/750] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:08:26.876358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.019937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ed18-370f-4408-8fc6-44bd4d22769c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.089059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393c152-6263-45b0-807e-ba73a6725758 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.148256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.149242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.149705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.150285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.151183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.151701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.154580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.155514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.155943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.156343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.157421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.158911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.166175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.185058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 376/751] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:26 2022] POST /identity/v3/services => generated 240 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:27.196284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 376/752] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.204698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.245462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.388597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3247b-bac5-446d-a210-cff26d497181 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.395762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.438306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.439022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.439406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.439993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.449364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.452281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:27.467970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:27.469010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:27.469928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 377/753] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:27.475484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.543861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.552315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b5ba4-9061-4169-afd3-7eb1de4fe4ac None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.597470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.619991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.620800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.621207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.621734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.644210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2cf9-bce0-499f-9184-15fb684c5828 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.644557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:27.653983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:27.656084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:27.657199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 377/754] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:27.674520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.708464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.709036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.709309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.709576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.710345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.710650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.712173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.733703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 378/755] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.739856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:27.868554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3e06-1f3a-4925-b352-a787d7e66fdc None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:27.912668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:27.913570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:27.913992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:27.914400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:27.915556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=4d2583f38c13417887002a80c64654bd) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:27.916028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:27.918456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:27.921648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:27.927564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 379/756] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/role_assignments?user.id=4d2583f38c13417887002a80c64654bd&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:27.989481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7084a-ed37-4195-9b36-1bf9e180925c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.074112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.075189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.075490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.075991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.076887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:28.077204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.078862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.091676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 378/757] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:28.096359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.255450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a5568-cd7d-4ae6-be3b-c0d12adc34e9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.294665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.295321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.295593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.295867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.309665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.311474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:28.329366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:28.331036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:28.332566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:28.332566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:28.332566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:28.332566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 380/758] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:28.342752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.389921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.562440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0996-671e-4ff0-9575-bc18aa80f47d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.625111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.626155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.626634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.627093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.628240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:28.628794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.631381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.654964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 379/759] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:28.661190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:28.784936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:28.866679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9f362-e1fd-4fe9-bea1-c4512e1c8380 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:28.933147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:28.933802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:28.934113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:28.934385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:28.944020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:28.945526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-2811397c-73ce-413d-a57c-8b162da9bc7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:28.961821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:28.963631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:28.965854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 381/760] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:28.973347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.102780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986602eb-ec14-4d33-8030-17faefc3e539 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.103246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986602eb-ec14-4d33-8030-17faefc3e539 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.103749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986602eb-ec14-4d33-8030-17faefc3e539 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.112141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 382/761] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:29.114385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.114819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.115239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.141059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.166571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:29.167903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:29.181626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc648-1d1d-4c5f-bff6-4cc92df2e3df None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.233961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.234588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.234865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.235135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.235884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.236192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.237701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.258792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 380/762] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.268031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.340176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 383/763] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:29.409556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f9fcd-4292-467e-a90d-46a092e41126 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.464993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.466277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.467022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.467725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.475037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.489569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.491116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-29ef3d97-1195-48de-bdf5-f90131699857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:29.514627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:29.515704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:29.517154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:29.517154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:29.517154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:29.517154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 381/764] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:29.523465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.584207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.693957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c89e6-72ce-44a6-b0df-8ac07ed94087 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:29.753876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:29.754687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.755069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.755342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.756218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:29.756783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:29.758868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:29.764753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33649dfd-6d46-4e4a-8f3c-dd844817d868 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.765731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33649dfd-6d46-4e4a-8f3c-dd844817d868 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.765731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33649dfd-6d46-4e4a-8f3c-dd844817d868 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.767379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 382/765] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:29.774113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:29.774626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:29.775869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:29.780239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 384/766] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:29.788922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.814337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:29.815729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:29.941588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 383/767] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:29.942706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:29.971995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:29.978062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76b4a-7303-46b4-92aa-5b18c14945ae None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.058772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.059991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.060799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.061264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.074406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.077775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.085100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8339d-0641-4133-aeae-5dfb2d44e5ed None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:30.100634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:30.103718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:30.106160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 385/768] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:30.110925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.113203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.170893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.171568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.171849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.172127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.172748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.174251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:30.201847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:30.203800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:30.205390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 384/769] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:30.209054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.323559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae6cd-e8ae-4f20-b2ee-1dc8e8648285 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.385836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.387246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.387943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.388688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.390129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:30.390850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.393592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.415980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 386/770] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:30.417734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.458744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.570751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5cd2c-07e3-4262-a441-a562bd8eeb4d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.577778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5262958-e506-40e6-a832-237258ac6ae5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.613781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.614418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.614691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.614960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.622816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.623871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.624162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.624597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.625626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:30.626103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.628349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.629379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-b4eb1f4b-8dd3-44f0-8132-60147e6fc808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:30.634917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:30.635902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:30.636933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:30.637940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 385/771] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:30.638671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.640195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 387/772] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:30.642016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c95001-8772-475f-9956-bc1cd0831bd4 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.642895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c95001-8772-475f-9956-bc1cd0831bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.643534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c95001-8772-475f-9956-bc1cd0831bd4 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.645925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 388/773] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:30.646971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c95001-8772-475f-9956-bc1cd0831bd4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.722576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.771665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:30.795759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ea85-020e-457a-a0e6-4f565de40444 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.809430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c95001-8772-475f-9956-bc1cd0831bd4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:30.860213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.861286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.861764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.862238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.867479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=2512318b0a854bd2934befc3de218102, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.869152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:30.870160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.870160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.870440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d87af-8d1a-4a16-9aa1-8b9d35fb63e4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.870578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.870916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:30.871204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:30.872728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:30.888193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 389/774] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:30.889198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:30.900017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 386/775] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:30 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:30.900017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:30.900017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:30.900017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:30.919975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:30.921273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:31.024251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 387/776] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:31.025235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.067328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.111755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2715-7482-465f-a7a8-f04835248455 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.150975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9cc39-4c93-4ffe-94d8-e3a363d253e7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.178469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.179931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.180740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.181519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.182918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.183674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.186387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc333f-bad2-4d9d-8bfc-22e29bd50d97 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.201698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.204255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628210-10e2-4a66-b48f-948026f64040 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.209286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628210-10e2-4a66-b48f-948026f64040 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.210043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628210-10e2-4a66-b48f-948026f64040 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.212688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 391/778] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:31.218987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.219798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.220528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.224695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.225640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.226160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.226622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.227811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] RBAC: Adding query filter params (interface=public, service_id=2a29c595a3754baabb684eb39fbad2cc, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.228318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.230707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.244828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.246224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 388/779] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/endpoints?service_id=2a29c595a3754baabb684eb39fbad2cc&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.248505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.254491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:31.257815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:31.384525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 392/780] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:31.385778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.392366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.396178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa06-db28-443c-87d5-b345e63c39f6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.439932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.441095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.441570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.442078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.454997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.457122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:31.475756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.477101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:31.478063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:31.478063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:31.478063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:31.485653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 389/781] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.487099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.520674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a32ec-7eb3-429f-8a49-bf9d71336eed None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.562761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.563786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.564257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.564777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.565631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.567445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.573617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.574117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 393/782] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.577935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.655172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab69b2-fe3d-408a-8419-4f3169ba615f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.705932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.707023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.707646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.708124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] PATH_INFO: `/v3/services/network` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.709154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.711166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.722527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.724150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:31.725786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:31.728653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 390/783] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.730384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.757176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d3c50-5f4d-4526-bd27-f095a5560d89 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.761952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.809508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.809508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.809508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.810258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.810380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.810816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.812511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:31.830924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 394/784] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:31.831917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.889432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d467-1869-4d49-b602-6f14e2b94eec None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.903600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:31.931530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.932570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.933029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.933464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.945627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:31.949370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f29d7-4fc8-4d49-94c1-c4fcc16a9275 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:31.951517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:31.952704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:31.953842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:31.960771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 391/785] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:31.961987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:31.991559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:31.992332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:31.992787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:31.993167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:31.993981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] RBAC: Adding query filter params (name=network) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:31.994386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:31.996039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.006678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 395/786] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.006678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.084559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.110383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d2669-af1e-469e-bb3e-f25b1de041d8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.153671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.154399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.154679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.154949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.163455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b6863-fc11-4417-ad33-b7f3c90eb161 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.164239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.165909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:32.179877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:32.181115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 392/787] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:32.182810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.200833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.219857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.220508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.220795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.221077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.221718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.222010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.223403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.240430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 396/788] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.240430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.325505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207da6d-e464-43c7-a694-5dfcb23aa3cc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.370884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.372419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.373157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.373682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.374607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.375230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.377194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.380231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.382290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a6d8f-53ee-4e76-a079-d01702538ed1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.391982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 393/789] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.393773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.430024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.430636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.430916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.431183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.432542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.432542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.434077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.456921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 397/790] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.457866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.518628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.537291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f891-3ff1-4478-9825-a408be3684c3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.577929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.579097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.579598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.580082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.581102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212df7e-cdfb-4c94-b835-2951431f7484 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.593116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.595071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:32.612572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:32.613632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:32.614548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:32.614548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.614548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:32.621584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 394/791] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:32.621584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.626900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.627648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.627907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.628171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.628940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] RBAC: Adding query filter params (interface=public, service_id=2bbf5b2bc7ac475c8cb6b353288f22de, region_id=RegionOne) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.629238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.630642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.651791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 398/792] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/endpoints?service_id=2bbf5b2bc7ac475c8cb6b353288f22de&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.651791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.702072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.766988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb28b7-b07d-41bf-bac1-167bca15118d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.802772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346b0ae-6c2a-4e9c-9163-6bf49b9687c3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:32.811787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.812902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.813521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.814179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.815122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.831941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.834156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.845407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:32.846008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.846285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.846554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.847210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:32.847510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:32.849222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:32.855187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:32.856248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:32.857873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:32.857873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:32.857873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:32.860087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 395/793] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:32.861206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.875378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 399/794] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:32.875378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:32.989766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5c2a2-eff5-45bf-9b83-24b8c9756d9c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.003458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8103a-43c2-4256-8ba7-78ed8a50b828 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.020801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.032281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.033170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.033550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.033911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.034688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.035083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.036732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.056025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 400/795] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.057195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.058699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.060529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.061220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.061831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.062739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.064657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.080517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 396/796] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:32 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.082106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.100798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.207185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613ed60-0eca-4e02-881e-fe7ee598a3ef None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.266409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.267261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.268027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.268474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.279331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc08d29-02b1-4c81-8df4-2a6e1f7058e5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.285041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.287703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-88691afe-8340-46fb-9121-ee5038eb2e38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:33.312470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:33.313489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:33.314442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:33.314981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 401/797] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:33.324248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1c6c-0c9f-4993-9598-8f3d4a0e613f None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.324786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1c6c-0c9f-4993-9598-8f3d4a0e613f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.325327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b1c6c-0c9f-4993-9598-8f3d4a0e613f None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.328234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 402/798] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:33.332491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b1c6c-0c9f-4993-9598-8f3d4a0e613f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.336356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.337684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.337965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.338551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.351421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.354061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e760d84d-c10d-45c5-9cb6-fa76296449d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:33.380165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:33.381203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:33.382114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:33.382581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 397/799] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:33.391925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.392690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.393177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.426012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:33.428378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:33.474572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.477038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.502052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b1c6c-0c9f-4993-9598-8f3d4a0e613f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.541237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 398/800] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:33.542167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.563598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.564622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.565440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.565946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.566833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.567289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.571429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.602370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 403/801] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.609105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.698806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b59e7-db51-4f81-aa51-79ba1f783db8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.741616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.742860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.742860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.743388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.744386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:33.744842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.746581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.758961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2093d9-7883-4fbc-8fb4-c9ddd0caff0b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.762608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 399/802] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:33.769398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.799324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.810688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.811637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.812060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.812596 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.837667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.839169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.860693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:33.888510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:33.889574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:33.890486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:33.890486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:33.890486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:33.890486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 404/803] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:33.899360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.986340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bfe16-9126-4209-ac71-89d3af88b04f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.036503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.037308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.037562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.038008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/e6160c9f7ca04f579b99202118032eef/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.062995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffc4cf-72e3-47ee-9734-3605806b75a0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.063705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=e6160c9f7ca04f579b99202118032eef, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.065292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066b39-e7fd-4271-b7c5-311f8d78437e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.081456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 400/804] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:33 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/e6160c9f7ca04f579b99202118032eef/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:08:34.082801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290ec4-56a0-493b-a85c-5fe5d415b9e0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.083088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290ec4-56a0-493b-a85c-5fe5d415b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.083357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290ec4-56a0-493b-a85c-5fe5d415b9e0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.085110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 401/805] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:34.085539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290ec4-56a0-493b-a85c-5fe5d415b9e0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.125979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.126602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.126873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.127192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.127852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:34.128244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.129917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f8a2-fd19-47b3-b0e0-4feeb6b54a9d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.145445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 405/806] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:34.147621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.148084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.148647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.178349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:34.180656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:34.181842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.230210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290ec4-56a0-493b-a85c-5fe5d415b9e0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.273070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.273070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.273070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.273606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.286121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:34.291702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.292737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:34.293611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:34.295474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 402/807] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:34.296600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.297280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.319408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 406/808] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:34.320684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.475537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cb2b-f28a-4168-8ee4-53f68e381967 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.489043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989e16-be99-4691-9b74-ca9d166993a8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.519858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.530759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.531734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.532150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.532670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.543903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.547199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:34.563197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.564329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:34.565546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:34.567510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 403/809] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:34.570495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.571278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.571702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.572117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.572958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:34.573393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.575026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.576746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.603137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 407/810] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:34.609849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.713191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.744609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2187-46ef-4ba3-a4a7-1848893fa688 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.783618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14bf09-03fa-4323-971a-313c6e50fa76 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:34.793120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.794048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.794476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.794875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.795701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:34.796158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.798046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.815078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 404/811] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:34.816159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.856896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:34.857667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:34.857820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:34.858012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:34.874136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:34.876021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:34.887998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:34.900508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:34.901636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:34.902570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:34.902570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:34.902570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:34.904873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 408/812] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:34.905857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:34.962917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658529d-f40d-4493-8594-5e5f51ee63b5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.012452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.013364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.013675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.014113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.014706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.016101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:35.030779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:35.032041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:08:35.032956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:35.034353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c907b4-5b78-4f88-8ba7-e4c96f7abfc9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.036461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 405/813] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Aug 29 20:08:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:35.037456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.037995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.087674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.088338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.088637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.088901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/4d2583f38c13417887002a80c64654bd/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.090892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=4d2583f38c13417887002a80c64654bd, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.092942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.112584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 409/814] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:34 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/4d2583f38c13417887002a80c64654bd/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:35.113905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.205295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b564f-040e-411c-b736-f4f27955480a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.224198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.265894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.269913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.270558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.271038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.271939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.272474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.274230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.303704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 406/815] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.312173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.352163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaffa5-489c-4e8a-b7fd-ca235d7a0f79 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.395738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.396842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.397336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.397812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.398772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.399290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.400984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.409258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 410/816] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.416453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.457972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185430-1ab5-46d5-81c7-d1461b352076 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.477581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.546269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.547050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.547362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.548008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.570442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.571175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:35.594797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:35.596830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:08:35.598754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:35.601364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 407/817] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:35.602748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.637271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30808f-b3f2-43de-9a4c-14cb4af8a873 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.675078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.692837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.693505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.693930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.694266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.694913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.695215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.696808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3b14-8800-4965-9cd8-fc684b9aaf32 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.705261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 411/818] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.712630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8299f-71f3-43e4-9b24-7e781079f756 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.712630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8299f-71f3-43e4-9b24-7e781079f756 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.712630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8299f-71f3-43e4-9b24-7e781079f756 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.713495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 412/819] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:35.715252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.715588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.716931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.742131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:35.743668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:35.838407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d185-6377-4cb5-b4c8-cf1d1b1c6862 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:35.841051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 413/820] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:35.842208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:35.901077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:35.937757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:35.938825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:35.939334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:35.939890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:35.940865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:35.941468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:35.943212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:35.991348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 408/821] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:35.997886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.097310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c589ef-d371-45c1-ada2-1fd1ed12ee5e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.157043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.160440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.161439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.162744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.163723 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.165806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.211967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.223595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 414/822] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:36.229882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.236951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf421b2c-0a86-4067-b03c-e1029977fc28 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.360228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.361337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.361940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.362486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.368801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.455774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0439e8-a7ab-483e-912c-c10290b7ca90 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.476714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.478121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.509815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.510940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.511485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.512242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] PATH_INFO: `/v3/services/network` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.513692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.520593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:36.550218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:36.552007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:08:36.553645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:36.561819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 415/823] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/services/network => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:36.569528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.600079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.638090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 409/824] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:36.645893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.705514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5139c9-acdb-4cd5-ad6c-1d6ac4ab4948 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.763513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.764856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.765487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.766141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.767649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] RBAC: Adding query filter params (name=network) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:36.768315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.771184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.777316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb19b3a-e003-4662-8afe-405a1851b15b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.782087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 416/825] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:36.787817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.792033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.821175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.822232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.822746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.823227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.837738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.839663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:36.858508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:36.859598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:36.860557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:36.860557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:36.860557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:36.862947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 410/826] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:36.871046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.903338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a19d-4e05-4eb0-a7da-bd0e849d0c2b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:36.929998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:36.948183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:36.949177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.949591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.950166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.952090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] RBAC: Adding query filter params (type=network) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:36.952682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:36.954399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94eebf-9e01-4f7b-9781-7f97c39d3672 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:36.961193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 417/827] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:36.967841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efb61c-edbc-4a91-be1f-b34ce897a7fe None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.968340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efb61c-edbc-4a91-be1f-b34ce897a7fe None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.968883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efb61c-edbc-4a91-be1f-b34ce897a7fe None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.970816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 418/828] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:36.971965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efb61c-edbc-4a91-be1f-b34ce897a7fe None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.029565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf47e-2b5d-4b2f-9fbb-4480f4852e9a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.067993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.113998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efb61c-edbc-4a91-be1f-b34ce897a7fe None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.116808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.119278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.119904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.120585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.121912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:37.123377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.126746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bef9f-1821-49f2-b5de-2bfc773e5038 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.152740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 411/829] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:37.155851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.156359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.156886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.160320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.161182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.161625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.162028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.162872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.164625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.179547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:37.181029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:37.196538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 419/830] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:37.198060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.308638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 412/831] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:37.432238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f3a1-7b79-4f59-8843-3525e9623433 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.465241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.483033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.484136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.484645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.485155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.493693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.495669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:37.516917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:37.517985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:37.519046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:37.523962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 420/832] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:37.531053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.599693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.709701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb626-049d-4f47-8198-a92f5b63b784 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.733576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.750538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.751212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.751481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.751756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.752483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:37.752795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.754330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.768384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 413/833] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:37.779570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:37.873116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002a8b-a6df-49f3-bcab-fe0a31c11424 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.894264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.921443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a9b4b-c6ff-4a3e-91a3-fa532b896283 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.924625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.925296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.926764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.926764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.940223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-9ab9fea2-a5e1-49dc-9413-6b984b423b93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:37.945932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:37.947078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:37.948008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 421/834] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:37.949341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bcdf-bfaf-47d2-bad0-a2801a454b12 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.949341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bcdf-bfaf-47d2-bad0-a2801a454b12 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.949341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5bcdf-bfaf-47d2-bad0-a2801a454b12 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.954722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 422/835] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:37.956938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.957262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.957534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.982648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:37.984703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:37.985017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.985615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.985893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.986234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.986968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:37.987282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.988864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.995831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 414/836] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:37.996485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.060536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.142531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c08d-be52-459a-a721-13bb2d7ec1f5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.187862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.188950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.189433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.189919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.191048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.191560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.195144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.210597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 415/837] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:08:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:38.217952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.232682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 423/838] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:38.241896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.368951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9764a6-176a-4f26-9c82-3d8da05d2ed1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.419251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.420249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.420652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.421029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.434347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.436786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:38.453815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.455051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:38.456288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:38.456288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:38.456288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:38.456714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 416/839] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:38.463189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.586582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d13df-e9ce-4070-826f-57e30e8a76fb None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.628348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.629050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.629335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.629599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.630246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:38.630543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.631933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.645322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 424/840] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:38.651030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.725732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.737919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.781031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199e04d-f39e-4980-ae73-728c5fff71c8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.781767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:38.825023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.826295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.827020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.827488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.836407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:38.840673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:38.859644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.860724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:38.861757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:38.863048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 417/841] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:38.869343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:38.882128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ed627-008a-463f-8a2c-101a9ca89046 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:38.929816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:38.930987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.931320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.931772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.943517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7a5a22fa-7309-46bf-82fa-1fd1bc4f4a31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:38.948250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:38.949952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:08:38.952828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:38.955054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 425/842] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:38.956207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c868-b3a7-4273-b10e-5b240b2de190 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:38.956511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c868-b3a7-4273-b10e-5b240b2de190 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:38.956788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c868-b3a7-4273-b10e-5b240b2de190 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:38.960593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 426/843] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:38.960593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317c868-b3a7-4273-b10e-5b240b2de190 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.023242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f0b37-4910-428a-8e02-c253c86cc680 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.052641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.067921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.068574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.069498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.069690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.070393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.070767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.072219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ac67-aff7-4dca-9b9b-0e1e77fb0355 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.097471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 418/844] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:39.100574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.101451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.102527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.106298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.115942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317c868-b3a7-4273-b10e-5b240b2de190 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.133578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:39.136021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:39.156150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.156803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.157076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.157333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.157996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.158301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.159688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.171024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 427/845] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:39.176214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.240786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 419/846] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:39.240786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.339831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bf3b-be07-4049-bbbc-30bec52a4ffa None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.383378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d7b9-57b2-4c85-bb6b-f97010f47dc4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.400572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.400914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.402010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.402606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.403664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.438363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.439369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.439886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.440368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.449798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.459193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.461576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:39.491271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:39.492286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:39.493242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:39.493242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:39.493242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:39.493242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 420/847] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:39.502706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.526724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.530054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.681506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7b6c0-bad2-4579-b442-18a0f9f8259c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.705790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 428/848] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:39.705790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.753994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.763646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.788694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 421/849] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:39.788694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:39.800816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.820959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:39.887072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6ff1-48ce-4a27-a7d2-8fb86cc623ae None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.943171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:39.944195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.944683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.945139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.946171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:39.948591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:39.950115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356be6-3f69-4612-ae0c-2f49e796998a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:39.964435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:39.966302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:39.967687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 429/850] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:39.968540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.025799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.026797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.027848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.028684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.048694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.050488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:40.068316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:40.070239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:40.071947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:40.071947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:40.071947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:40.071947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 422/851] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:40.071947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.123550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a15be-7c3b-49af-926d-e4aed6c7cfb6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.157879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.173696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.181144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.182062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.182560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.183076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.195980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.198210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:40.213282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:40.214898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 430/852] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:08:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:40.217544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.222600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b8c3f-98d0-4ab5-b926-6ea311c4f8be None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.263803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.264685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.265139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.265592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.266628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.267145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.269749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.277027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 423/853] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.278606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.391624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5475f4-dce6-489c-86c5-5c02c3889fa5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.443875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.444603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.444885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.445159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.445840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.446140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.447704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.454558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ddca-5d44-4541-a2ba-632086f4a732 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.461952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 431/854] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.462804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.502037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.503018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.503398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.503836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.504971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.505472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.507859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752772c-33dd-4058-aa22-f1d33f7146ac None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.521377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.532584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.538122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 424/855] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.540160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a6a-3ec0-4135-b7cd-511dd848f66f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.540661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a6a-3ec0-4135-b7cd-511dd848f66f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.541093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a5a6a-3ec0-4135-b7cd-511dd848f66f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.548757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 425/856] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:40.549879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5a6a-3ec0-4135-b7cd-511dd848f66f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.611523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4641fa3-09ad-47a1-8edb-68eba2df93b9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.655019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.655621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.656099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.656189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.656839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:40.657185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.659048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.663957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 432/857] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:40.664826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.682047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a5a6a-3ec0-4135-b7cd-511dd848f66f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.753912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.754647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.755725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.756030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.766114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.767727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-89eedd8d-cb0d-4183-a51e-66208bf126b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:40.781111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:40.782348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:40.783462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:40.787376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 426/858] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:40.788801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.789089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.789355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.813542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:40.815620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:40.836061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da884a-3149-434a-be51-24610a631f7b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.840139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.892890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.900833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.901594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.902229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.902782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.919616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 427/859] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:40.921234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.010519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.012703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.097611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ede1ce-5381-48ba-beb9-dc07e15e8ff9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.167883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.170085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.170736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.171695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.173479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:41.174135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.178678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.211497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 428/860] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:41.219066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 433/861] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:41.221563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.227313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.233831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.295914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.377368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d34-1793-4d39-b533-08d6643ea234 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.378730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44709d-2325-4ff7-9c28-46393835b147 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.418818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.419885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.420310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.420772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.422034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=e6160c9f7ca04f579b99202118032eef) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:41.422504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.425024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.430366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.431355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.431934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.432359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.445175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 429/862] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/role_assignments?user.id=e6160c9f7ca04f579b99202118032eef&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:41.445175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.456362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.458064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:41.476956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:41.478105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:41.479029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:41.479029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:41.479029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:41.484231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 434/863] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:41.485317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.573937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.591158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21728e-ca19-4fe1-b552-311cfdcd583b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.609631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.641393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.642637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.643063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.643338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.643985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.646261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.648444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703d327-1dbd-4406-903f-7fe218453179 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:41.658428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:41.659467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:41.660370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 430/864] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:41.666857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.712331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.713195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.713479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.713751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.714448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:41.714898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.716280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.735202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 435/865] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:41.742252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.816149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18626fd-2d0b-4de1-bb33-ecd1d1183199 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.867945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.869230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.869513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.869782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.870711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:41.871016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.872794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.881393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 431/866] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:41.889094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:41.889891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c1cc-211a-4258-8d4d-84c082cf5b06 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:41.911024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.941179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:41.942347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:41.942898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:41.943512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:41.949578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:41.959712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:41.962975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:41.980992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:41.982944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:41.984929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:41.997043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 436/867] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:41.997043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.039336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70a87a-3c09-48e2-ac0f-32040a6ad2da None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.080422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.081147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.081432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.081748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.082389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.082691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.084083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.090157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 432/868] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:42.143607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33e23-c003-4567-8f4b-37da48400337 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.187095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.187095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.187095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.187453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.188155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.188495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.189968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ecae-3bfa-4097-b404-36d51cfc1692 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.208569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 437/869] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:42.210727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:42.354335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6172b-73b2-4827-8f70-2c254e3ab8f3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:42.356054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:42.399675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:42.400686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:42.401110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:42.401554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:42.402788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=4d2583f38c13417887002a80c64654bd) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:42.403677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:42.406233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc812d-69d4-4b91-bde1-639c0dbccfb9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:42.417876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 433/870] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:42 2022] GET /identity/v3/role_assignments?user.id=4d2583f38c13417887002a80c64654bd&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:43.132104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf245-a82c-4382-b6f5-038552ec35bf None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.132580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf245-a82c-4382-b6f5-038552ec35bf None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.132951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf245-a82c-4382-b6f5-038552ec35bf None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.134688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 438/871] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:43.141364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6ac5-f89b-4695-b1e8-d109e69527f5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.142131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6ac5-f89b-4695-b1e8-d109e69527f5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.142131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6ac5-f89b-4695-b1e8-d109e69527f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.162028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-580e6ac5-f89b-4695-b1e8-d109e69527f5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:43.163356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-580e6ac5-f89b-4695-b1e8-d109e69527f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:43.245948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 434/872] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:43.561001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf245-a82c-4382-b6f5-038552ec35bf None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:43.615773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.738886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf245-a82c-4382-b6f5-038552ec35bf None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:43.787897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:43.788775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.789200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.789477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.790169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:43.791671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e05be-c83c-43f1-a964-4ad1cee4472f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:43.817360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 439/873] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:43 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:43.961244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9825-ec27-45bf-bac3-947f85820df6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.962252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9825-ec27-45bf-bac3-947f85820df6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.963126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f9825-ec27-45bf-bac3-947f85820df6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.967352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 435/874] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:43.982985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.983568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.984055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.006361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:44.008309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:44.102874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 440/875] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:44.437774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9825-ec27-45bf-bac3-947f85820df6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.574266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.583037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f9825-ec27-45bf-bac3-947f85820df6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.624789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.625452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.625735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.626011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.637767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b6f0ebad-aa43-4814-bac5-24df5383f019 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:44.643130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:44.644165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:44.645090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 436/876] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:44.653182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.684849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.743084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b4ea-7c57-43af-9470-2a5a906a7f83 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.743287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b4ea-7c57-43af-9470-2a5a906a7f83 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.743535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b4ea-7c57-43af-9470-2a5a906a7f83 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.745917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 437/877] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:44.752712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7da0-d232-4e01-922e-caea5ae19c2c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.753371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7da0-d232-4e01-922e-caea5ae19c2c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.753835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7da0-d232-4e01-922e-caea5ae19c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.777675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2aea7da0-d232-4e01-922e-caea5ae19c2c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:44.779712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2aea7da0-d232-4e01-922e-caea5ae19c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:44.798126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4c69f-836c-4599-81f4-b106b4604393 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.854634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.856137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.857004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.857577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.858949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:44.859284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.860766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daff52e-dc78-4292-8b65-ef84fa7cc28d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.870777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 441/878] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:44.872288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e744-faad-49cf-b5ca-6e302dbd6c45 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.873067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e744-faad-49cf-b5ca-6e302dbd6c45 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.873375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e744-faad-49cf-b5ca-6e302dbd6c45 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.879159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 442/879] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:44.879330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 438/880] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:44.880829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.881072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.881348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.883515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e744-faad-49cf-b5ca-6e302dbd6c45 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.905757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:44.907175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:45.005342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 439/881] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:45.033486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.057633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e744-faad-49cf-b5ca-6e302dbd6c45 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.115322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.116628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.117146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.117636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.131527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.133372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:45.149735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:45.150764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:45.151655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:45.151655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:45.151655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:45.154362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 443/882] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:45.160426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.171606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.192790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.286817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6619128-c59e-4fdc-aaa7-0c8f5d5e9ff4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.305536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48dd4e-9095-4b7c-9e09-d04ebdd8ce79 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.323399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.324035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.324309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.324621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.325264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:45.325674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.327371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.344100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 440/883] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:45.345100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.346437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.347269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.347833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.348286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.349275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.350832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.355836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.374049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 444/884] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:45 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:45.376222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.442443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.470660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4f93-a837-4d45-8ae8-362ccf3d8640 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.518796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.519454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.519788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.520017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.529707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.531749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:45.545440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:45.546760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:45.547704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:45.551504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 441/885] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:45.552510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.554803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75c9ff-d169-495c-b298-4658f7f461ce None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.615279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.615932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.616208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.616507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.617444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.619135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:45.629998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:45.631090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:45.632157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 445/886] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:45.640926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.720952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828d68-e7e5-4cda-bc22-4a6db95cb72b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.748720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.775274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:45.783614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.784439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.784810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.785138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.785968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:45.786332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.788051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.812675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4c5fb-26df-4de1-b370-5b5fc95bf3d4 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:45.813701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 442/887] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:45.814731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.857094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:45.857864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:45.858138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:45.858399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:45.859043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:45.859362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:45.861111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:45.871837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 446/888] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:45.873188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:45.950197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f862fa5-5ee0-4fc5-8f2f-78394b1327b3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.019980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.021306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.021936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.022562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.055114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756f9d-6626-4756-aa12-9c07e9ca6d99 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.097531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.115692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.116664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.117116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.117559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.118593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:46.119091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.121473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712bec6-2669-45f4-9c41-8be7c80c59a6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.134676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 447/889] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:46.137436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.158390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.161055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.243352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dc5c7-3272-43c0-9268-5d75816c6b99 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.243629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dc5c7-3272-43c0-9268-5d75816c6b99 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.243887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dc5c7-3272-43c0-9268-5d75816c6b99 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.245600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 448/890] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:46.251631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.251883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.252162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.276456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:46.277836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:46.347655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 443/891] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:45 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:08:46.348571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.391013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 449/892] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:46.460626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.478926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e74b-aab8-451f-b720-a277f35dffab None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.524116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.525050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.525552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.525975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.538345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.540181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:46.556903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:46.558154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:46.559263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:46.559263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:46.559263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:46.561704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 444/893] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:46.570770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.684164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.724983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bcca-6422-4831-be89-854bfead5ff0 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.753257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.779556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.780362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.780896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.781396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.782546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:46.783560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.785712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.804762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 450/894] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:46.813589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.828474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef281-f2b2-4f81-9643-d128a89a9da2 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:46.882812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:46.884216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.884917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.885650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.886908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:46.889840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:46.907781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:46.909207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:46.910263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:46.918020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 445/895] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:46.923585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:46.944911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:46.959745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190ea1b-b0fa-470a-91b0-343d0b3ea8d6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.024019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.024752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.025048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.025344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.036692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.039226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:47.058335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:47.059328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:47.060712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 451/896] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:47.066764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.115960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc0698-76f6-4cd5-94b9-d22cd17152fc None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.137545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.196784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.198164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.198890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.199594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.201060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:47.201844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.205297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.214562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 446/897] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:47.223671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.251053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683be945-8622-415e-853a-df2dd1726aa4 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.298805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.299736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.300116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.300493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.301401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:47.301941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.303747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.319170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 452/898] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:47.327782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.338556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.384077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc664f-5915-4a29-b0b5-8e6db77c7603 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.428897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.429517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.429798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.430071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.430859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:47.431169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.432773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.439594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 447/899] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:47.447196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.477231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4627-5df6-437e-b943-21ea8d220920 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.512963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.534453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.535283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.535622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.535901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.538032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] RBAC: Adding query filter params (role.id=ada28571698c4ce8b5e8bfe7be7a69c0, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=e6160c9f7ca04f579b99202118032eef) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:47.538876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.540903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.550030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 453/900] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/role_assignments?user.id=e6160c9f7ca04f579b99202118032eef&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=ada28571698c4ce8b5e8bfe7be7a69c0 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:47.615085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20b44c-763f-45ce-996b-343b17156a5d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.665504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.666141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.666461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.666732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.667449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] RBAC: Adding query filter params (interface=public, service_id=84cbc31b4e124e749451ae71150eb157, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:47.667756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.669214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d1cab-4504-4805-bba6-24a6b41a31aa None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.671269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.676962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 448/901] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/endpoints?service_id=84cbc31b4e124e749451ae71150eb157&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:47.686060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.749890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e426c-d9f0-43cb-98f1-93fe813f5a41 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.750556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e426c-d9f0-43cb-98f1-93fe813f5a41 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.751048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e426c-d9f0-43cb-98f1-93fe813f5a41 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.752961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 449/902] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:47.758565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.759148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.759640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.781788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:47.783434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:47.861057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03fe8-3d1a-4b86-84c0-d44061780106 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.892906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 450/903] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:47.908811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.909436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.909756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.910078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.910703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:47.912222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:47.920823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 454/904] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/services => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:08:48.284324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.459235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d429-a35d-4379-898a-f569c5399ed1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.509500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.518187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.519189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.519471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.519745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.520513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.521963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-650183e1-fea8-45de-b9ec-3fadc5ae3067 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:48.533328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:48.534453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:48.535380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 451/905] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:48.543063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.582054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.666293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e866f-326b-4293-9fc2-d8b230b602ae None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.698634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987611-c1d1-4ad0-9c10-67c0945a17f9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.699195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987611-c1d1-4ad0-9c10-67c0945a17f9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.699716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2987611-c1d1-4ad0-9c10-67c0945a17f9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.702566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 452/906] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:48.707728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.708101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.708270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.712023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.713187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.713678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.714149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.715353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:48.715898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.719617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.726927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 455/907] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:48.731903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:48.731903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:48.734588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:48.846376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 453/908] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:48.860836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:48.875007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab5298-0313-47ad-b26c-8a60b3fd78c6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:48.923901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:48.924560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:48.924837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:48.925104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:48.926209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:48.926694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.928092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.936199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 456/909] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:48.943394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.119483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eae1b4-9e5d-4140-b844-32c967d11e33 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.163073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.176511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.182022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.182871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.183252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.183624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.184725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] RBAC: Adding query filter params (interface=public, service_id=859b027fb77c473eab8ce7728a4f1950, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:49.185537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.187746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.197651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 454/910] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:48 2022] GET /identity/v3/endpoints?service_id=859b027fb77c473eab8ce7728a4f1950&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:49.206718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:49.307109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41173-7105-4367-ae81-b53e859e35ec None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.352117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.353822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.354450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.355161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.357232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.360217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf937d9-44ce-4631-9181-6e3d1df6d384 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.380642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 457/911] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:08:49 2022] POST /identity/v3/services => generated 241 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:49.402534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798f6b-0db0-488a-8c37-328653fa94b8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:49.482457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:49.483111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.483360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.483615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.484220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:49.486206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0e1a8-3b0c-42aa-a81d-2019f4694965 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:49.493898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 455/912] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:49 2022] GET /identity/v3/services => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:08:49.615884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db0de-4f55-428b-a79a-bab7a136d0dc None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.616230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db0de-4f55-428b-a79a-bab7a136d0dc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.616492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47db0de-4f55-428b-a79a-bab7a136d0dc None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.618369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 458/913] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:49.624317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:49.624665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:49.624926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:49.646016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:49.647262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:49.702896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:49.736203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 456/914] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:50.021164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47db0de-4f55-428b-a79a-bab7a136d0dc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.048380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.170356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47db0de-4f55-428b-a79a-bab7a136d0dc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.213788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.214802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.215286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.215621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.235634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7d5e8717-9f36-4ca1-9b91-c6c481a6d591 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:50.245198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:50.247004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:50.249007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 459/915] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:50.253431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.331395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266b95-8fdc-47da-b9e6-ce0ad2fd246a None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.331661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266b95-8fdc-47da-b9e6-ce0ad2fd246a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.332001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266b95-8fdc-47da-b9e6-ce0ad2fd246a None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.334758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 460/916] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:50.339364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.339801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.339980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.362680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:50.362680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:50.430687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351200f9-c94f-415e-9523-c5fe389bf67e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.468571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 461/917] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:50.487620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.489003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.489758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.490423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.491598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:50.492258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.495184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.506500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 457/918] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:50.513297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.519551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.636657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db551eea-5b09-47af-bdf4-5a52ea15a77c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.682558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.683258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.683530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.683794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.696277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.697831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:50.715104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:50.716126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:50.717610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:50.717610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:50.717610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:50.717610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 462/919] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:50.723041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.761243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.770120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.841788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:50.848165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fbbcf-8012-4c95-bba1-b2da0c5ad906 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.885972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.886637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.886919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.887194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.887848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:50.888257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.890204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.896051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4ffb-f43d-4f49-b560-5af210a4b85a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:50.906226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 458/920] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:50.913539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:50.949379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:50.950161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.950641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.951040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.952057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:50.953833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:50.966886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:50.969625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:50.972694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 463/921] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:50.983621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.079765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07253-0f5e-443d-9d45-04137c011359 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.096657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.115912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1865236-ba80-4362-89dd-cf79e36d7fc9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.134778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.135944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.136432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.137262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.141600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.147164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.152279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.165270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.166263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.166772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.167490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.168230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.168715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.170802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:51.174563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:51.175801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:51.176788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:51.178805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 464/922] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:51.179314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 459/923] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:51.185119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.189023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.297843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc2fe-9849-49ae-848e-f730fe04d5db None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.334445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.334971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.335245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.335509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.336216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.336547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.337927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.343649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 465/924] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:51.349496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.377962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583bee4-94d3-402d-8c83-07057a43dd57 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.417152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.426341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.427149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.427433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.427707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.428585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.428906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.430369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.453254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 460/925] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:51.460904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.490778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c536c-b061-4229-bc06-500ebf3f7550 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.492133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.545724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.546795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.547271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.548235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.549195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.551509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b8e4-faab-4535-8063-cccdb33d24ef None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.595408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 466/926] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:08:51.651880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27687-a579-4a74-b06e-2db21292b4d1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.697829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834384-d778-42bc-9dc3-afc61c88985e None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.698286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834384-d778-42bc-9dc3-afc61c88985e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.698645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834384-d778-42bc-9dc3-afc61c88985e None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.700439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 467/927] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:51.712489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feeb77-0c4e-4512-a973-bfb24cd2bb68 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.712911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feeb77-0c4e-4512-a973-bfb24cd2bb68 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.713605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51feeb77-0c4e-4512-a973-bfb24cd2bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.716588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.717946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.717946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.718321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.736932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.739603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.739839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-51feeb77-0c4e-4512-a973-bfb24cd2bb68 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:51.741394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-51feeb77-0c4e-4512-a973-bfb24cd2bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:51.760223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:51.761715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:51.763609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:51.763609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:51.763609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:51.763609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 461/928] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:51.769958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.843661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 468/929] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:51.846056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24034fa-e9b9-4936-9075-b84be4adba07 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.846056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24034fa-e9b9-4936-9075-b84be4adba07 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.846056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24034fa-e9b9-4936-9075-b84be4adba07 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.848250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 469/930] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:51.854953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.855213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.855344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.874056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.881485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:51.882051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:51.925610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da26bc-33e9-4e8c-b3d2-7ec6d070f70f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.937542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.993380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.993380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.993380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.993380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.993876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:51.993876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.993876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.009639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 470/931] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:52.017050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 462/932] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:52.025802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.167523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.206642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800dcc-f9e4-4a16-8aac-031f9e82c19b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.248647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.249536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.249866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.250214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.258305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.260043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:52.276464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:52.278122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:52.279980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 471/933] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:52.288867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.329128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:52.346330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9551-2ced-4380-a397-0e522e4dcf59 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.386800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:52.404220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.405761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.406177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.406568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.407576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.409866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:52.426283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:52.428141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.430153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 463/934] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:52.433030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.482155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e209ad-1220-436b-aea3-1abd5b9d4ba1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.548051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.549091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.549587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.550045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.551345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:52.551884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.554587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.585681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 472/935] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:52.585681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.622314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987446-9b8f-4a51-96ff-148691285013 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.692177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.693352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.693820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.694289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.695351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.697949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.709819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:52.720094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:52.722034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:08:52.723760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:52.728581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 464/936] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:52.730530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.743694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae60c1-671e-43a2-8a68-2b90d8fbabfb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.796815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.798470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.798927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.799392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.800456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:52.800772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.803180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.809329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 473/937] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:52.810837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:52.827801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:52.902392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd78f2-4b13-429e-99f3-227c445e3879 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:52.947551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:52.947980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:52.948135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:52.948789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/e6160c9f7ca04f579b99202118032eef/roles/ada28571698c4ce8b5e8bfe7be7a69c0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:52.950649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=e6160c9f7ca04f579b99202118032eef, role_id=ada28571698c4ce8b5e8bfe7be7a69c0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:52.952432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:52.972467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 465/938] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:08:52 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/e6160c9f7ca04f579b99202118032eef/roles/ada28571698c4ce8b5e8bfe7be7a69c0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:08:52.973402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.029807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a476-c1ed-4342-95f0-1a676ba5f696 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.099857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.100956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.101439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.101960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.103104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:53.104058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.106052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.116560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 474/939] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:53.125415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.145278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:53.163617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce144caa-863b-42dc-a4c5-0057ae1aa186 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.182582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:53.219328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.220317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.220931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.221416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.222552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:53.223069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.225677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.234731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 466/940] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:53.242362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.285336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f60d22-5504-4d42-a0fe-e4d68ad17f5f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.348728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.349342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.349615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.349879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.350517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:53.350811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.352422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.360810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 475/941] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:53.369230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.419614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745efa65-d1db-4bff-b3f5-ad25b5732348 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.490737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.491705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.492192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.492723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.494356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] RBAC: Adding query filter params (interface=public, service_id=2d37b02c30be4009b70dd69241010500, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:53.494902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.497726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.508191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 467/942] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/endpoints?service_id=2d37b02c30be4009b70dd69241010500&interface=public®ion_id=RegionOne => generated 194 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:53.517269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:53.537630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:53.571457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7c25d-930f-4020-9ac5-7305529f535c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.608721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:53.647733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.651037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.651037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.651037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.651037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.653370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a735b8-0fa5-4158-b069-7d86fe286799 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.704553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 476/943] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:53.738154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbdf40-2b2b-4497-83af-0794a7f67db5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:53.834503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:53.837095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:53.837936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:53.838820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:53.840379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:53.844536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376b4eb-6e22-400a-ac97-c3b90b7fc57c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:53.859891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 468/944] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:08:53 2022] GET /identity/v3/services => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:08:54.199895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77567-33ee-486b-86ea-4b7f2fb9c24d None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.200212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77567-33ee-486b-86ea-4b7f2fb9c24d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.200623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77567-33ee-486b-86ea-4b7f2fb9c24d None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.202300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 477/945] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:54.208700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.208985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.209308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.230083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:54.231437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:54.315336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 469/946] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:54.651040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77567-33ee-486b-86ea-4b7f2fb9c24d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.790518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77567-33ee-486b-86ea-4b7f2fb9c24d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:54.826881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:54.836174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:54.837025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.837366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.837633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.838556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:54.840341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:54.843846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING keystone.server.flask.common [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 20:08:54.867138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.sql.core [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:54.867138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:08:54.867138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [parameters: {'id': '27fafb1ec1014ebab44e69531174fe4b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:08:54.867138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81651) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27fafb1ec1014ebab44e69531174fe4b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27fafb1ec1014ebab44e69531174fe4b. Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:54.875990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 20:08:54.876893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application yield resource Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise self.value Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application session.commit() Aug 29 20:08:54.878004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:08:54.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:08:54.879908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:54.880749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [parameters: {'id': '27fafb1ec1014ebab44e69531174fe4b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:54.881610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:54.882431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27fafb1ec1014ebab44e69531174fe4b. Aug 29 20:08:54.883480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:54.887825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 478/947] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:54.894436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:54.934666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.037669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa0fcf-719c-4a79-9789-8bc4b0c903f7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.084818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.085484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.085773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.086120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.095092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.096609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-65d0a124-4524-4018-b6b6-ac205a1519c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:55.116324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:55.117686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:55.119213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:55.124490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 470/948] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:55.126343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.266889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b110a5-a573-44ad-90c8-9d2db7dc9877 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.322719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.323344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.323630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.323915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.324634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:55.324936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.328742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec7c8e-9ae9-4507-8e45-158a5bc6dd4f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:55.361679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 479/949] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:55.553372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58274e7-54c4-48d2-87e8-f4a9dfbc64e0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.553607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58274e7-54c4-48d2-87e8-f4a9dfbc64e0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.553945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58274e7-54c4-48d2-87e8-f4a9dfbc64e0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.555867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 471/950] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:55.562150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aba0-5445-48d6-b8c6-22e6e3e69480 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.562602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aba0-5445-48d6-b8c6-22e6e3e69480 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.562813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aba0-5445-48d6-b8c6-22e6e3e69480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.585474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2d37aba0-5445-48d6-b8c6-22e6e3e69480 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:55.587814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2d37aba0-5445-48d6-b8c6-22e6e3e69480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:55.674014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.730417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 480/951] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:56.029799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b403ad-0bf3-4380-8a14-764fac129171 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.029799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b403ad-0bf3-4380-8a14-764fac129171 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.029799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b403ad-0bf3-4380-8a14-764fac129171 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.031003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 472/952] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:56.037130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b3031-2467-46d2-bb90-59ed9a694ca3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.037887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b3031-2467-46d2-bb90-59ed9a694ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.038373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b3031-2467-46d2-bb90-59ed9a694ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.065565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f58b3031-2467-46d2-bb90-59ed9a694ca3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:56.067577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f58b3031-2467-46d2-bb90-59ed9a694ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:56.139461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b403ad-0bf3-4380-8a14-764fac129171 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.162612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 481/953] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:56.278282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.293348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b403ad-0bf3-4380-8a14-764fac129171 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.322733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd606-be65-4837-a909-9e536f9d9436 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.323186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd606-be65-4837-a909-9e536f9d9436 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.323331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd606-be65-4837-a909-9e536f9d9436 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.325003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 482/954] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:56.330663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.330926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.331221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.349612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.350759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.351399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.351884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.357681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:56.359525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:56.366833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:08:56.372656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:56.373970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:08:56.375089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:56.378149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 473/955] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:56.384953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.476605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 483/956] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:08:56.495244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.548606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.566210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c435-e406-4dd6-ac93-550a93cc4e1d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.609320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.610342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.611084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.611548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.612650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:56.613316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.614970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.632355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 474/957] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:56.640590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.653450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce2dd0-16a0-47ab-bdb7-4f1ec8671ae9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.668887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.714445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.715418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.715837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.716232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.717533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.719953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:56.737736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:56.739904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:56.741428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 484/958] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:56.749079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.838419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162b15b-438e-46d0-855e-d6ec98360858 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.881896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.882560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.882871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.883138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.900000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:56.902543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.920444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec1e84-7fe3-4a61-9463-2abaa4f1bc83 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:56.922840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:56.923994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:56.925213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:56.925213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:56.925213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:56.925429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:56.925504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 475/959] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:56.925504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:56.996932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:56.997655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:56.998017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:56.998827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:56.999323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:56.999867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.002080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.012733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 485/960] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:57.014390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.062938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.137786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33ece1-74a2-4dc8-bb91-cab537f27473 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.189921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c526-84a4-4c59-b931-66c0af5c9bc3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.201451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.202127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.202654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.202937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.203544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.205640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:57.218928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:57.220266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:57.221323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 476/961] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:08:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:57.222321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.262769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.263963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.264538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.265433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.266558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.267108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.269891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.298348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 486/962] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.299342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.351938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.403702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a1a25-c577-406b-84f6-5adb9d11a6cd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.455997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.463464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b435b-810f-40cd-bbc0-d33c1fde40e6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.469626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.470520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.470791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.471059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.471701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.472002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.473434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.478698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 477/963] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.479546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.547980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.549613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.550408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.551184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.552996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.554016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.556729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.570023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 487/964] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.582216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.682105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71df27-bff2-4daf-b217-317aa9b31d62 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.745958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.746945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.747393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.747672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.764847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.767087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:57.796159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:57.798000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:08:57.800780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:57.802627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.803260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 478/965] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:57.812443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.826568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc93ea-d4a3-459e-b8bd-4c3cb3f09472 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:57.899758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:57.905827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:57.907514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:57.908203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:57.908918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:57.910540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:57.911363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:57.914603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:57.928075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 488/966] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:57.940511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:57.996644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a1b34-bf9e-4caf-87e7-6716158e5bf4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.044299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.045283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.045753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.046059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.047261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:58.047809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.050372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.071711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 479/967] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Aug 29 20:08:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:58.078868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.088722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b97eb-dc4a-4f0f-be0c-6efce4390255 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.143331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.144050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.144327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.144638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.145465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.147078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912355-4680-471b-bbd1-916b3d6d6072 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.181142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 489/968] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:08:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:08:58.182780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dba27-b3ae-4b46-8a29-98f669225a14 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.183071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dba27-b3ae-4b46-8a29-98f669225a14 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.183531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dba27-b3ae-4b46-8a29-98f669225a14 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.192728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 490/969] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:08:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:58.194736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.195232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.195614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.225941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:58.227296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:58.232220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.266941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f06a0d-b59c-4398-8b0f-dddfb3a17577 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.284813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.345683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.347034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.347855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.348649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.357387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 491/970] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:08:58.474632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.476730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:58.663311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 480/971] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:08:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:08:58.672367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.737968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:58.748010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.877973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd5b7-2c67-4009-b52c-e575bb8a32d4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.926366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffef373-f0a5-4cf9-8b91-d1b02e302ee8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:58.956383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:58.957352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:58.957755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:58.958151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:58.972229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:58.985292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:58.992510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.016516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.017863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.018374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.018864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.019808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.021876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:08:59.022247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:59.023543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:08:59.025380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:08:59.025380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:08:59.025380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:59.025380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 492/972] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:59.031375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:59.032259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING keystone.server.flask.common [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 20:08:59.062334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.sql.core [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:59.062334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:08:59.062334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [parameters: {'user_id': 'c1cf4e8bb85643b6ac6d013a75edac04', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:08:59.062334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81650) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:59.105676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:59.107219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application yield resource Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise self.value Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application session.commit() Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:08:59.109718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:08:59.111584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:08:59.113280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application result.read() Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:08:59.114712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c1cf4e8bb85643b6ac6d013a75edac04', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:59.115716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 20:08:59.119496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 481/973] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Aug 29 20:08:58 2022] POST /identity/v3/users => generated 160 bytes in 372 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:59.121670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:59.225085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77533a-5ecf-4041-8366-94d660ac55b9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:59.291419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:59.321668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.323292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.324031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.324757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.326275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:59.327433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.330530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.354059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70028c7c-7038-4d6f-8957-111246dffa32 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:59.362205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 493/974] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:59.363544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:59.417856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.419425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.420258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.421040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.437771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.441493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:08:59.462266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:59.463552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:08:59.464641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:08:59.465338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:59.468255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 482/975] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:08:59.478665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:59.544622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045037b-496d-4778-b4c7-bbc536cb9896 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:59.587650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.589059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.589563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.590050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.601478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.603835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.622398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cee1b7-9518-4867-b633-823a5297896d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:08:59.622924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:08:59.624176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:08:59.625376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:08:59.627503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 494/976] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:08:59.636144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:59.673803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:59.693374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.694429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.694892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.695311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.696377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:59.696926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.699225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.751692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 483/977] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:08:59.765433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e6222-be30-4890-afe5-bcb4c5df3215 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:59.786899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:59.817595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:59.818146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:59.818420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:59.818680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:59.819448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:08:59.819747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:59.821385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca91c-f819-49e4-ba06-d09cfcd9d7fc None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:59.840901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 495/978] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:08:59.849038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:00.015853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15dacb-9949-4f17-ac33-7ad2c856c173 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:00.075133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:00.075766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.076048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.076322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.077205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] RBAC: Adding query filter params (role.id=ada28571698c4ce8b5e8bfe7be7a69c0, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=e6160c9f7ca04f579b99202118032eef) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:00.077512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:00.079003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1dfb-095a-4f22-b2d9-b3bdfeb741f1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:00.086653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 484/979] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:08:59 2022] GET /identity/v3/role_assignments?user.id=e6160c9f7ca04f579b99202118032eef&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=ada28571698c4ce8b5e8bfe7be7a69c0 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:00.196738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea329-6050-443b-b75f-1164fc2e9efb None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.197574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea329-6050-443b-b75f-1164fc2e9efb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.197717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ea329-6050-443b-b75f-1164fc2e9efb None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.199831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 496/980] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:00.208994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3375-b367-42df-b430-19af01a7ebc7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.209744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3375-b367-42df-b430-19af01a7ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.209744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3375-b367-42df-b430-19af01a7ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.245358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2d0c3375-b367-42df-b430-19af01a7ebc7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:00.248200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d0c3375-b367-42df-b430-19af01a7ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:00.323345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:00.361757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 485/981] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:00.623879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42b46-16c4-4fd4-8666-f58bd2452524 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.624130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42b46-16c4-4fd4-8666-f58bd2452524 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.624375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42b46-16c4-4fd4-8666-f58bd2452524 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.626029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 497/982] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:00.632237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.632684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.633130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.656027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:00.657432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:00.719311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42b46-16c4-4fd4-8666-f58bd2452524 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:00.785760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 486/983] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:00.890845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42b46-16c4-4fd4-8666-f58bd2452524 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:00.947313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:00.948416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:00.948946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:00.949469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:00.950587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:00.952668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:00.981287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 498/984] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:00 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:01.099401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.271987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83739-c8be-4894-9458-18c5a73b1bf0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.285247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.325724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.326382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.327517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.327517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.328000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.329453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:01.340065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:01.345725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:01.346710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 487/985] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:01.350590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.391076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.520710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369075-2dc8-4d90-a82f-76b107f680d2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.573090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.573883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.574287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.574693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.575868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:01.576381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.579121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.587411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 499/986] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:01.593372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.746721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98115f-0ec8-4671-a7f5-310d8d8b3d85 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:01.797187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:01.797187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:01.797710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:01.798108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:01.798868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:01.799272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:01.801607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:01.808494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 488/987] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:01.814943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:01.953085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:01.963235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cbe80-cc62-44ba-82c7-d5ef5f6f1d0c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.012813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.013588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.013952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.014405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.015236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] RBAC: Adding query filter params (interface=admin, service_id=2d37b02c30be4009b70dd69241010500, region_id=RegionOne) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:02.015640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.017156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac15f-90cd-47db-922f-5b69d45cf6f3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.023777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 500/988] 10.222.0.20 () {56 vars in 1249 bytes} [Mon Aug 29 20:09:01 2022] GET /identity/v3/endpoints?service_id=2d37b02c30be4009b70dd69241010500&interface=admin®ion_id=RegionOne => generated 193 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:02.030305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:02.082229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:02.206130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec4bec-ce7a-4d38-902d-e645f9cbd8cb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.237764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed020c-032d-4a08-82a4-06282a6b4c91 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.238124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed020c-032d-4a08-82a4-06282a6b4c91 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.238304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed020c-032d-4a08-82a4-06282a6b4c91 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.239683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 501/989] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:02.256596 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.256872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.257261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.283032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.283981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.284149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:02.284425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.285346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.285848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.286037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:02.288130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.304741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 489/990] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:09:02 2022] GET /identity/v3/services => generated 1727 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:09:02.393031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 502/991] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:02.699348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:02.842926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:02.850585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd6e1d-f447-4224-8c8f-8d078b835416 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:02.893494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:02.894160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:02.894438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:02.894705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] PATH_INFO: `/v3/services/image` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:02.895305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:02.896742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:02.912788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:02.913991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:02.914944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:02.916822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 490/992] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:02 2022] GET /identity/v3/services/image => generated 86 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:02.920650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:03.084193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:03.099200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f741-9aa8-4842-81dd-064a626df011 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:03.159082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:03.159701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.159982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.160301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.160993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:03.161288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:03.162711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065d7d9-48a6-4e58-88fd-98681d57f9f2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:03.171395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 503/993] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:03.177128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:03.273000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ff34-5a0b-41e2-8f76-a7c2a10ff87b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.273263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ff34-5a0b-41e2-8f76-a7c2a10ff87b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.273407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ff34-5a0b-41e2-8f76-a7c2a10ff87b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.275137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 504/994] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:03.281442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.281761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.282033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.301911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:03.303188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:03.351869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb42ec-e40d-4fc9-b0e2-c4ba48ef678d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:03.398972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 505/995] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:03.401602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:03.402607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.403073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.403521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.405097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:03.405733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:03.408116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:03.421080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 491/996] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:03.681570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:03.806072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:03.830521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd677-16ad-48ce-b785-eb3b331930e1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:03.883688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:03.884431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:03.884877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:03.885268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:03.885868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:03.887599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:03.898247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:03.900994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:03.901886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 506/997] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:03.912607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:03.955052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:04.068256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24713982-1b65-45d6-91eb-6058b2b1fcc1 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:04.114271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:04.114902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.115189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.115461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.116102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:04.116433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:04.117863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:04.125099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 492/998] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:04.130927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:04.271480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405021c-7880-4601-ada2-803124a3f7f2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:04.313907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:04.314634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.314915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.315169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.315785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:04.316096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:04.317546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:04.330310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 507/999] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:04.331384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:04.486605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:04.502658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551db13-367d-434d-bf73-8410f05b90e3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:04.548875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:04.549214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.549497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.549769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.550484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] RBAC: Adding query filter params (interface=public, service_id=cdc8af2c007f421b9b5d95a402bab312, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:04.550830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:04.552269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc490-1180-46e6-85b3-7b474fc036ef None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:04.559959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 493/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:09:04 2022] GET /identity/v3/endpoints?service_id=cdc8af2c007f421b9b5d95a402bab312&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:04.567405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:04.586682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:04.596237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fd3b-c278-45ef-a7c8-26da19524c57 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.596718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fd3b-c278-45ef-a7c8-26da19524c57 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.596921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fd3b-c278-45ef-a7c8-26da19524c57 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.598542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 494/1001] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:04.605313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.605603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.605960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.626769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:04.628045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:04.715093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e97b38-2cad-41db-b6d7-a2cb369dbcf8 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:04.732452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 495/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:04.771354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:04.772355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:04.772938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:04.773513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:04.774484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:04.777199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:04.789974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 508/1003] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:09:04 2022] GET /identity/v3/services => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:09:05.038732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.173574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.198027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6edb2-bb9a-400f-87b0-4aa34058a442 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.264633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.265707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.266177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.266650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.267950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.270595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:05.288205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:05.289847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:05.290700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 496/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:05.300080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.412697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.451321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda8e-bf00-498a-a938-0ed85cf0722e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.510920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.511916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.512420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.512862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.513906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:05.514449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.517553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec36d9-db9d-472a-a9fb-d7dbbf2edc8a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.527162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 509/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:05.535646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.612083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa30de-6d8e-465e-a133-b8dbd130d7b1 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.612693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa30de-6d8e-465e-a133-b8dbd130d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.612693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa30de-6d8e-465e-a133-b8dbd130d7b1 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.614168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 510/1006] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:05.619400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.619678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.619934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.641205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:05.642423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:05.667806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7753-de40-482a-b7be-c6b52c67a725 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.717302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.718070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.718359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.718675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.719331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:05.719651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.721192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.727744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 497/1007] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Aug 29 20:09:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:05.735478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:05.748431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 511/1008] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:05.757867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.869293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4a4e-4e4f-4f0a-a2a8-b9686967c6c4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:05.910739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:05.911278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:05.911559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:05.911848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:05.912691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:05.914140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a1bb-6c74-4e9c-9058-bcdab5601565 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:05.936954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 498/1009] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:06.046968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:06.149639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:06.206051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ee5f-61e1-4f43-8577-78476f762210 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:06.290320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:06.291426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:06.291871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:06.292369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:06.293610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:06.297188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885886f-e6c5-4524-a5c8-c1df42ba31e1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:06.327006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 512/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:06 2022] POST /identity/v3/services => generated 242 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:07.190753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cd87-7ead-4d72-a6f4-378db4ba0045 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.191356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cd87-7ead-4d72-a6f4-378db4ba0045 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.191356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739cd87-7ead-4d72-a6f4-378db4ba0045 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.192663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 499/1011] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:07.198561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.199126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.199126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.219960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:07.221206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:07.320532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 513/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:07 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:07.590095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739cd87-7ead-4d72-a6f4-378db4ba0045 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:07.708893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:07.764433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739cd87-7ead-4d72-a6f4-378db4ba0045 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:07.803826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:07.804496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:07.804779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:07.805119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:07.805713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:07.807202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:07.821596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:07.822713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:09:07.823617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:07.828492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 500/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:07.832697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:07.908285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:07.991513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e470f12-25ef-4a69-880c-7b26f1e2d04b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:08.032472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:08.033490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.033916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.034402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.035497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:08.036038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:08.038374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:08.052571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 514/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:08.054112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:08.211240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea561c-38b3-4372-a185-29d5e24cc0ba None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:08.263776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:08.264408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.264855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.265135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.265867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:08.266181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:08.267610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f62b2-7d74-435b-b099-1e2631db81ba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:08.270229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:08.280436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 501/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Aug 29 20:09:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:08.284723 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:08.417854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaaacd-846c-478b-bfa2-586fa1d0a571 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:08.440620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:08.463059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:08.463896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.463896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.464211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.465048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:08.466537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4a968-b602-4420-bba2-26ea03742c4e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:08.491493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 515/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:08.543827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce384b-bd2c-4cf1-93fc-5cd5d6ea1845 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.543827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce384b-bd2c-4cf1-93fc-5cd5d6ea1845 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.544175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce384b-bd2c-4cf1-93fc-5cd5d6ea1845 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.546080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 502/1017] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:08.551727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751fc9-4516-479f-bc00-bbe94c628dba None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:08.552044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751fc9-4516-479f-bc00-bbe94c628dba None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:08.552283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46751fc9-4516-479f-bc00-bbe94c628dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:08.578180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-46751fc9-4516-479f-bc00-bbe94c628dba None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:08.580368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-46751fc9-4516-479f-bc00-bbe94c628dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:08.690526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 516/1018] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:08.982064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce384b-bd2c-4cf1-93fc-5cd5d6ea1845 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.079560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42baa7-a56e-4abf-85f8-57a726da261e None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.080005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42baa7-a56e-4abf-85f8-57a726da261e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.080154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42baa7-a56e-4abf-85f8-57a726da261e None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.081947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 517/1019] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:09.088736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.088986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.089258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.116750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:09.118745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:09.138226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce384b-bd2c-4cf1-93fc-5cd5d6ea1845 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.178831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.179527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.179808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.180079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.181262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.182713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.184648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 503/1020] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:09.193439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.226180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 518/1021] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:09.278340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.325707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee75b2-47a4-4e0e-9f09-356cb4c9c452 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.379552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.380576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.381235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.381770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.382616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.384286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.422401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 504/1022] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:09 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:09.522352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.579695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:09.724761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d86af-016b-426e-8fc0-5c36a597e551 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:09.791424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:09.792438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:09.792871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:09.793332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] PATH_INFO: `/v3/services/image` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:09.794327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:09.795978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:09.808698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:09.809862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:09.810740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 519/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/services/image => generated 86 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:09.817372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:09.989101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e905bc8-00bd-4c98-a78e-7b590e2b70bd None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.018714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.044450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.044717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.045003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.045416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.046606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] RBAC: Adding query filter params (name=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:10.047093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.049596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.056801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 505/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:10.063260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.198399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:10.214632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3857e-3266-4407-874d-2ba156611302 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.271685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.272239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.272563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.272793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.273447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] RBAC: Adding query filter params (type=image) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:10.273746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.275239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.283164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 520/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:10.288237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.424478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc272d-39b0-4eaa-8c98-e6208d19f8df None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.474501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.475751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.475751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.475751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.476038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] RBAC: Adding query filter params (interface=public, service_id=72eb489976c848a1af1dc66338f7816b, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:10.476300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.477830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3ea00-61e6-4d39-91f3-29d85316071d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.491111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 506/1026] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/endpoints?service_id=72eb489976c848a1af1dc66338f7816b&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:10.492590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:10.651519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d890c1-6655-4872-b2a3-b965b1b061da None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:10.726377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:10.727026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.727314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.727586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.728783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:10.730230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8522-8487-41ec-8f45-c4c0027ce44b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:10.740840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 521/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:09:10 2022] GET /identity/v3/services => generated 1957 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:09:10.897265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30767-d08f-48ad-91d4-392aebf99641 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.897609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30767-d08f-48ad-91d4-392aebf99641 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.897963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a30767-d08f-48ad-91d4-392aebf99641 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.899391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 507/1028] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:10.905683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:10.906120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:10.906374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:10.927400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:10.928638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:10.947165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.026721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 522/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:11.306667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30767-d08f-48ad-91d4-392aebf99641 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.376862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.476353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a30767-d08f-48ad-91d4-392aebf99641 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.540755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.541783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.542253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.542795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.563033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-04faf689-e054-4beb-851e-25e8a8ef0a3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:11.572914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:11.574190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:11.575095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:11.580008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 508/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:11.585475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.645688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3bd1d-1812-448b-bc4e-77f94c595642 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.646160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3bd1d-1812-448b-bc4e-77f94c595642 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.646585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3bd1d-1812-448b-bc4e-77f94c595642 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.650210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 509/1031] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:11.657533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.657820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.658124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.680120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:11.681444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:11.743684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51761576-6d08-4144-b41e-58ad8384e229 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:11.764442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 510/1032] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:11.791412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:11.791699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:11.791946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:11.792173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:11.792899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:11.793194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:11.794628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:11.805757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 523/1033] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:11.811309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:11.869236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:11.956234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b206-c647-4ebf-a4c9-2649e1242f75 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.013585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.014354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.014472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.014940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.027064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.028795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:12.052367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:12.053444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:12.059438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:12.059438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:12.059438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:12.059438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 511/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:12.059732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.061129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.076473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.191087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.196385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff731d-492e-4edb-a482-cb478fcc893d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.208033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc70e43-d60d-453b-9d67-91fe17a48b8b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.242325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.246846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.246846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.246846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.246846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:12.246846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.248718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.262694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.263854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.264214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.264621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.271796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 524/1035] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:12.271996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.271996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.271996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:12.273309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.275850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.375444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.415193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196389-d988-48b9-9278-7396eb311c84 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.422979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9375-7be9-4471-b9cf-1a02454ee9fb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.458996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.459519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.459789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.460077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.468603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.469841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.470242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.470783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.471223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.471621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.472594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.474623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:12.483606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:12.485094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:12.486058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 525/1037] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:12.490746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.507263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 513/1038] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:12 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:12.628440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abcd84-13b7-4b00-8702-248cc62af795 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.668921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.676099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.677109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.677109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.677411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.678112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:12.678420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.679871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a04fd3-3ef8-48b6-bb1e-4faf868f3e4c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.700169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 526/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:12.708705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:12.733882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:12.836232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1e133-f860-4918-99af-74d3ac267b91 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:12.865592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8d66-7f35-4cfb-b1f8-35d4b6ca9894 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.866462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8d66-7f35-4cfb-b1f8-35d4b6ca9894 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.866462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8d66-7f35-4cfb-b1f8-35d4b6ca9894 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.867475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 527/1040] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:12.872701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.873044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.873412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.876881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:12.877512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:12.877797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:12.878068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:12.897082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:12.898527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:12.984540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:12.986705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:12.992724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 528/1041] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:13.007987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.131118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 514/1042] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:13.137563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.278897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.294804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1fdb9-e372-46b6-b145-0558c62696de None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.328993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.348534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.349508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.350470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.350893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.364245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.365865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:13.382326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:13.383654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:13.385178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:13.385178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:13.385178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:13.388268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 529/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:13.389057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.429765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7151a-9e27-4d0b-ab52-439c01c93b1a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.446509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.470986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.471741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.472076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.472462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] PATH_INFO: `/v3/services/image` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.473055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.474461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:13.485427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:13.486932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:09:13.487989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:13.491709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 515/1044] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:13.492648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.533662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f041b4-9658-48ae-b4f7-19747fd27fd5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.573995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.574639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.574904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.575172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.575828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:13.576152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.577832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.593855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 530/1045] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:13.599667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.643894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.647181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e3ea-ee66-4700-8e0e-0b710f893414 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.705783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.706818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.707259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.707789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.708754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] RBAC: Adding query filter params (name=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:13.709257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.711600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.720508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 516/1046] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:13.727094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.768024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e814d63-fb3f-4831-abcf-89c2d4889690 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.778082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.811986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.812680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.813292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.813855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.824940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.826441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:13.839079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:13.841898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:13.843916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:13.847268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 531/1047] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:13.847268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.861113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749ded1-f980-4dd9-9bae-e4592e66d055 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:13.907077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:13.908092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:13.908620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:13.909103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:13.910247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] RBAC: Adding query filter params (type=image) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:13.910788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:13.913513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:13.927915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 517/1048] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:13.929615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:13.986870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:13.998025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ed66-6238-4dff-8f7a-4d18d33b4363 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.064334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54b2e-5c56-4e42-8690-1eea51689a00 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.066059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.066750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.067086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.067419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.068191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:14.068519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:14.069997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:14.073368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.084842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 532/1049] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:14.092543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:14.110673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.111323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.111616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.111814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.112517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:14.113951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1a85b-4d21-4702-8e75-d231b6c16367 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:14.148737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 518/1050] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:09:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:09:14.266281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f731d0a-662a-406c-8f52-2b9b83877c8d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:14.338940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:14.339943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.340128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.340512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.341598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] RBAC: Adding query filter params (role.id=ada28571698c4ce8b5e8bfe7be7a69c0, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:14.342126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:14.344208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c47b2-7ee4-4e19-adc4-79311a7180cd None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:14.355741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 533/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:14 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=ada28571698c4ce8b5e8bfe7be7a69c0 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:14.612459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab0215-33ca-4425-9025-92bccae9b403 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.613257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab0215-33ca-4425-9025-92bccae9b403 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.613257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab0215-33ca-4425-9025-92bccae9b403 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.614871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 519/1052] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:14.620763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:14.621203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:14.621626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:14.640879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:14.642286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:14.650895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:14.734124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 534/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:15.029752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab0215-33ca-4425-9025-92bccae9b403 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.200263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab0215-33ca-4425-9025-92bccae9b403 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.244355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.245019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.245263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.245516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.259209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:15.265005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:15.268977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:15.270237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 520/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:15.275304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.443578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09717c05-2184-4c4e-933e-fa4a48e21367 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.501089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.501691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.501983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.502259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.502886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:15.503177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.504793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.518120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 535/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:15.526762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.564225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:15.664843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565cfe0-c761-44b1-97d9-7fb58ced91eb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.707373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.708271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.708685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.709060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] PATH_INFO: `/v3/users/777735e6a3b4477a94b3b213fdb186cd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:15.728844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] RBAC: Authorizing `identity:get_user(user_id=777735e6a3b4477a94b3b213fdb186cd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:15.730333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:15.732329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 521/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/users/777735e6a3b4477a94b3b213fdb186cd => generated 285 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:15.740072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:15.745704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:15.882988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c45c8-fadf-4eed-9dd8-28e55eb8f51d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:15.926675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:15.927278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:15.927553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:15.927944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.029795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.032008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2102-f99a-46f0-a41d-98fd33a29b33 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.036965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.178517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 536/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:16.184759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.299922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.332792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a620-48a9-4411-9955-8ce66408eac6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.339469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864b1e-203c-43e2-ae24-7ae86f74f955 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.340096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864b1e-203c-43e2-ae24-7ae86f74f955 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.340096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864b1e-203c-43e2-ae24-7ae86f74f955 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.341407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 537/1058] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:16.348311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3269df-3f61-4d3b-9dc6-8d0b01ee5f6a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.349000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3269df-3f61-4d3b-9dc6-8d0b01ee5f6a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.349460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3269df-3f61-4d3b-9dc6-8d0b01ee5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.377052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2a3269df-3f61-4d3b-9dc6-8d0b01ee5f6a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:16.378664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2a3269df-3f61-4d3b-9dc6-8d0b01ee5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:16.391889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.392562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.392869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.393573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.394877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.396322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.398116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 522/1059] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:16.404304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.471912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 538/1060] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:16.478200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d7ed-9812-4f05-a938-e4fc0c21f1e9 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.478430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d7ed-9812-4f05-a938-e4fc0c21f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.478653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d7ed-9812-4f05-a938-e4fc0c21f1e9 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.479993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 539/1061] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:16.485428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.485776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.486004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.505936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:16.507157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:16.537070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1263b96-9a9e-4e99-9369-5b50d4948114 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.540080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.592451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 540/1062] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:16.597525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.598149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.598477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.598675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.599402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=e97aeaaac04d40518dcddae92e353d31, user.id=777735e6a3b4477a94b3b213fdb186cd) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:16.599726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:16.601403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:16.608163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 523/1063] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/role_assignments?user.id=777735e6a3b4477a94b3b213fdb186cd&scope.project.id=e97aeaaac04d40518dcddae92e353d31&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:16.747376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.883434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:16.885692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bb8e-c1c1-497e-ac9d-8d96325a917c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:16.906266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:16.938348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:16.938983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:16.939251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:16.939524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:16.993782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.024254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fd06-e5bb-4c17-b90a-7fb4572ff69e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.044772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.046792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.085235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.086212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.086527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.088566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.106037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:17.115115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:17.116190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:17.117523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 524/1064] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:17.125991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.224461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 541/1065] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:17.227207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.249802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.294778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a276c-1df6-4092-b980-ba1e0334819f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.341213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.342108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.342715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.343286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.345149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:17.345518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.347768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.348929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.360064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 525/1066] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:17.365965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.403015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca6684-20fd-44dc-916e-1efcbc72d88c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.448862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.449867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.450384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.450638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.466877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.469141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:17.490258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:17.491356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:17.492289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:17.492289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:17.492289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:17.493064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc280e6-0602-46a2-a4b4-e4665dc13f5a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.493414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 542/1067] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:17.497628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.545086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.545981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.546430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.546849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.551808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.565768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.568305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:17.587664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:17.591757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:17.593398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:17.593398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:17.593398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:17.594254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 526/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:17.595379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:17.649591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651681-5a54-404d-8d16-42f95cbed4ed None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.676230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:17.710109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.710907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.711375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.711668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.712458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:17.712869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.714318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.734908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 543/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:17.772530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96993629-a89a-4686-8d38-ccf56fc98e42 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:17.824383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:17.824986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:17.825243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:17.825631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:17.826351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:17.826674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:17.828475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:17.848510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 527/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:17.851231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.002158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5ca-49cc-4709-bb17-b3486b7d549a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:18.049159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:18.050033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.050486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.050937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.060660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:18.062733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:18.078217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:18.079687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:18.081209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:18.081861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 544/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:18.086980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.157459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:18.225192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf8b0a-6560-4447-a666-d61d2b703e59 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:18.265682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:18.266489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.266765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.267034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.267774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:18.268076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:18.269658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.290330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 528/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:18.296635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.357905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:18.432607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2766-33e5-4e55-810f-90afa87263b1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:18.470961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:18.471968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.471968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.472194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.484419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:18.485943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-4254f685-73fc-4b1a-ae8a-502da00e30a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:18.501713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:18.503735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:18.505609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:18.505609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:18.505609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:18.505609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 545/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:18.509274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.593107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12279-4b3c-4382-8018-447a415db392 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.593420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12279-4b3c-4382-8018-447a415db392 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.593792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12279-4b3c-4382-8018-447a415db392 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.595168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 546/1074] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:18.600717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.600989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.601254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.625036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:18.626363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:18.635661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e233-7b72-433a-ac9e-2199b34babff None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:18.638070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:18.686965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:18.687686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.687984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.688282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.688998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:18.689297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:18.690848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.705395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 529/1075] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:18.711391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.717762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 547/1076] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:09:18.840808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e5e3-bef1-4a05-92dc-f3b49e431688 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:18.878937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:18.879498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:18.879776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:18.880064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:18.887946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:18.889484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:18.902616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:18.904023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:18.905194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:18.908595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 530/1077] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:18.910164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:18.935059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:18.996665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.029193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:19.033840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d281-fd3e-4e8e-9752-b59c3a0467bb None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.083638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.084259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.084559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.084838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.085520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:19.085862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.087266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.100520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 548/1078] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:19.107095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.121982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecf58-02ec-4c00-86b8-62fba692a872 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.167874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.167874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.167874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.167874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.181762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:19.186390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:19.187694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:19.188637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 531/1079] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:19.194485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.213957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:19.242732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6ac7-a91a-4766-bbbc-42ca94819211 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.299252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.299972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.300264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.300576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/ada28571698c4ce8b5e8bfe7be7a69c0` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.302921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=2512318b0a854bd2934befc3de218102, role_id=ada28571698c4ce8b5e8bfe7be7a69c0)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.304696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.312572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:19.321148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 549/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:19 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/2512318b0a854bd2934befc3de218102/roles/ada28571698c4ce8b5e8bfe7be7a69c0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:09:19.336202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41065f-583c-489e-b700-9bc00531a0d8 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.378217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.378854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.379116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.379395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.380078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:19.380380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.381841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.392426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 532/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:19.399189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.534469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e05b7-ecb6-4763-b67e-e1bc3a73556f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.574917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.575569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.575822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.576086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] PATH_INFO: `/v3/users/777735e6a3b4477a94b3b213fdb186cd` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.577344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] RBAC: Authorizing `identity:get_user(user_id=777735e6a3b4477a94b3b213fdb186cd)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.579831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.581467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 550/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:19 2022] GET /identity/v3/users/777735e6a3b4477a94b3b213fdb186cd => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:19.587996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.697424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a79897-bff9-4b7c-ab46-3f8e795b8753 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.734773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.735617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.736053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.736519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.738286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.740337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d16e-9409-4b6c-b85e-251d58fdcbb7 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.742779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 533/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:19 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:19.748906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:19.759517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:19.865523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954d7e-c2c2-407f-9de2-9cc2d91bb138 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:19.917904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:19.918565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:19.918835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:19.919099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31/users/777735e6a3b4477a94b3b213fdb186cd/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:19.921003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] RBAC: Authorizing `identity:create_grant(project_id=e97aeaaac04d40518dcddae92e353d31, user_id=777735e6a3b4477a94b3b213fdb186cd, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:19.922575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59777e-a2a0-4102-9214-df519e17feed None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:19.939279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 551/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:19 2022] PUT /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31/users/777735e6a3b4477a94b3b213fdb186cd/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:21.499704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f876-fdb1-4ae6-9f28-66aae58c77d1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.500311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f876-fdb1-4ae6-9f28-66aae58c77d1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.500311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05f876-fdb1-4ae6-9f28-66aae58c77d1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.501918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 534/1085] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:21.508034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4bd9d-5571-4f83-9ce2-34cd5c8ada02 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:21.508587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4bd9d-5571-4f83-9ce2-34cd5c8ada02 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:21.508587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4bd9d-5571-4f83-9ce2-34cd5c8ada02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:21.531071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-62c4bd9d-5571-4f83-9ce2-34cd5c8ada02 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:21.532453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-62c4bd9d-5571-4f83-9ce2-34cd5c8ada02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:21.623168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:21.635397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 552/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:22.130570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f876-fdb1-4ae6-9f28-66aae58c77d1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.159700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.171107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76ca13-d81b-4b49-af72-913905e8ba6b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.171387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76ca13-d81b-4b49-af72-913905e8ba6b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.171783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76ca13-d81b-4b49-af72-913905e8ba6b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.173282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 553/1087] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:09:22.179280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.179660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.179996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.201212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:22.202469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:22.275257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05f876-fdb1-4ae6-9f28-66aae58c77d1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.278481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 554/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:22.320835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.321490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.321767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.322035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.335138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:22.340894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:22.342014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:22.343399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 535/1089] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:22.348585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.460881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf383d6-b848-43a8-a957-230babd706d7 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.489181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.498778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.499601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.500039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.500607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.501430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.501728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.503139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.512799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 555/1090] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:22.518848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.559565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.607940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.641903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea60cc-bb90-4597-beff-0365ab92a95e None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.678583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cc931-1e67-4ef9-8ff5-b11688b4a5a9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.682608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.683251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.683526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.683796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.695916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.697439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:22.713180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:22.714435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:22.716671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:22.716671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:22.716671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:22.716671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 536/1091] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:22.721351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.725686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.726338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.726626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.726882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.740999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:22.746185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:22.748286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:22.750161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 556/1092] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:22.753958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.821417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.865263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9177fb-5952-4147-af6f-fa9b1399d6d6 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.888493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbd77-6da3-4e92-b073-849f19414c5b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:22.904275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:22.915515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.916158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.916470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.916749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.917423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.917732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.919204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.933026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 537/1093] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:22.935559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:22.936180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:22.936485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:22.936846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:22.937569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:22.938316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:22.939838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:22.940075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:22.950503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 557/1094] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:22.957304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.074176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218f65-29c5-45ae-adb2-4fbfd1f2febe None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.090191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f636f-c0ef-495c-becd-7c2e76e7c3f5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.102990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.113450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.114140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.114443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.114737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.123235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.124933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.131917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.132583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.132840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.133116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] PATH_INFO: `/v3/users/777735e6a3b4477a94b3b213fdb186cd` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.134364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] RBAC: Authorizing `identity:get_user(user_id=777735e6a3b4477a94b3b213fdb186cd)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.135805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.137452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 558/1095] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/users/777735e6a3b4477a94b3b213fdb186cd => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:09:23.138772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:23.139990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:23.141227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 538/1096] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Aug 29 20:09:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:09:23.145202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.147024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.226520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.274564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d10bb-7b12-4db9-b598-5d72ca9555f9 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.309869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74bf8-30aa-49eb-8d34-2c94d89c1e8d None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.327240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.327750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.328463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.328949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.362467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.363106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.363382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.363675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.364427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:23.364735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.366263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.386896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.392441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 539/1097] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:23.397311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.419710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.421110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.519422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37abec-c425-4365-8c84-9bc04dd0fa69 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.522445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.558498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 559/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:23.565318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.570497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.571167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.571477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.571750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.650922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.652425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.657019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.683155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb7c10-b7f3-4a07-a756-3de4576fef81 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.732952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.733756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.734103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.735873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.737387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.739793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.747786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 560/1099] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:23.749139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.779284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 540/1100] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:09:23.785595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:23.788683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:23.869209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bcbd2-a6f5-4f74-b0a5-bc52828fa8b4 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.904319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5a06-2bfd-4814-a0e5-a054f3a1656a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:23.914102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.914998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.915233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.915529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.916344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=e97aeaaac04d40518dcddae92e353d31, user.id=777735e6a3b4477a94b3b213fdb186cd) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:23.916710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.918353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.925981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 561/1101] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/role_assignments?user.id=777735e6a3b4477a94b3b213fdb186cd&scope.project.id=e97aeaaac04d40518dcddae92e353d31&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:23.955259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:23.956033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:23.956372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:23.956764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:23.970312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:23.971878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:23.997132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:23.998941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:09:24.001744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:24.001744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:09:24.001744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:24.001744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 541/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:24.010660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.031263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.150606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475abf0-bf08-41a4-8379-8522d3922dcd None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:24.198341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:24.198896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.199172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.199451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.200131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:24.200475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:24.201892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:24.217199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 562/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:24.224174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.295615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.355481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ea4c5-f932-4ab8-824c-1add0ff25b58 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:24.400784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:24.401330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.401770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.402115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.411664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:24.413635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:09:24.427334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:24.428488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:24.429459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 542/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:24.434698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.521595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.558579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32a8a-2e55-4a82-84fb-07da79a898b0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:24.601688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:24.602436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.602714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.603019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.603769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:24.604076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:24.605802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27ffa-24f2-4e19-a1ee-a821a8b0bdde None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:24.619941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 563/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:24.626425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:24.752016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a8615-86b0-4358-8db3-78f0496d2576 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:24.771366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:24.793136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:24.793801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:24.794182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:24.794550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:24.795385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] RBAC: Adding query filter params (role.id=ada28571698c4ce8b5e8bfe7be7a69c0, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=2512318b0a854bd2934befc3de218102) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:24.795785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:24.798103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88185d-a94a-4f1e-b387-0deec3aa2b69 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:24.805193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 543/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:24 2022] GET /identity/v3/role_assignments?user.id=2512318b0a854bd2934befc3de218102&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=ada28571698c4ce8b5e8bfe7be7a69c0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:26.020621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4aff-f3b4-404e-a4d5-c3c7116eb672 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:26.021211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4aff-f3b4-404e-a4d5-c3c7116eb672 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:26.021211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4aff-f3b4-404e-a4d5-c3c7116eb672 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:26.022551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 564/1107] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:26.028579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:26.029350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:26.029507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:26.053317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:26.054561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:26.145845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 544/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:26.415947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c4aff-f3b4-404e-a4d5-c3c7116eb672 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:26.526242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c4aff-f3b4-404e-a4d5-c3c7116eb672 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:26.558008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:26.564910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:26.565744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:26.566095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:26.566296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:26.567520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:26.569059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e051f-771c-4e89-98bf-a764fc63e88c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:26.570759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 565/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:26.577991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:26.698221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7d00-dc55-439e-adb3-db974c5181bc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:26.710843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:26.740796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:26.741438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:26.741752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:26.742054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:26.742784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:26.744554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c336c-c5ef-473c-92a5-d3185eb48adc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:26.770258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 545/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:26 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:28.720199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1da4a-03a9-4f2d-ad98-dda87565c98b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:28.722074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1da4a-03a9-4f2d-ad98-dda87565c98b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:28.722074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1da4a-03a9-4f2d-ad98-dda87565c98b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:28.722619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 566/1111] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:28.728566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:28.729066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:28.729165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:28.755160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:28.756462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:28.836742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 546/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:29.103110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1da4a-03a9-4f2d-ad98-dda87565c98b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:29.215246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1da4a-03a9-4f2d-ad98-dda87565c98b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:29.252103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:29.252864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:29.253138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:29.253400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] PATH_INFO: `/v3/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:29.254789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] RBAC: Authorizing `identity:get_role(role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:29.256143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:29.257532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 567/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:29 2022] GET /identity/v3/roles/acda13de619a41d5b6fafe2f998424fb => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:29.263553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:29.359649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:29.367126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7428479-8bf9-44dd-a072-3f7de3f7b7ad None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:29.403198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:29.403915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:29.404234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:29.404555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] PATH_INFO: `/v3/users/2296c7792eab4d93a875cc9943ba87bb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:29.420150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] RBAC: Authorizing `identity:get_user(user_id=2296c7792eab4d93a875cc9943ba87bb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:29.421669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:29.423672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 547/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:29 2022] GET /identity/v3/users/2296c7792eab4d93a875cc9943ba87bb => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:29.429967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:29.498750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:29.541857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c770b8-2142-4b6a-9ba0-2b3b03a00ec5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:29.577641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:29.578244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:29.578553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:29.579039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:29.653174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:29.654652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:29.726411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:29.785426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 568/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:29.792162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:29.902808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6359b-2d9b-4aeb-9690-d79da5af229a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:29.939315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:29.939936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:29.940260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:29.941180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:29.941990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:29.943424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a72ac-cc10-4bbd-94f0-f5be5bffaabf None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:29.945103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 548/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:29 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:29.951536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:30.068205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664160ed-fed6-421b-9b4c-d45a391ca287 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:30.113023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:30.113650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:30.113921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:30.114183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:30.114933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=e97aeaaac04d40518dcddae92e353d31, user.id=2296c7792eab4d93a875cc9943ba87bb) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:30.115258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:30.116724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe303ca-aff6-483e-9f68-68fe7cbdec79 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:30.123181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 569/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:29 2022] GET /identity/v3/role_assignments?user.id=2296c7792eab4d93a875cc9943ba87bb&scope.project.id=e97aeaaac04d40518dcddae92e353d31&role.id=acda13de619a41d5b6fafe2f998424fb => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:32.020536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f718b-a62a-4da6-8dab-79cc9c8fef62 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:32.021103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f718b-a62a-4da6-8dab-79cc9c8fef62 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:32.021103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f718b-a62a-4da6-8dab-79cc9c8fef62 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:32.022407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 549/1118] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:32.027787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:32.028238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:32.028352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:32.049710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:32.050958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:32.077381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:32.126150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 570/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:32.387823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f718b-a62a-4da6-8dab-79cc9c8fef62 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:32.419174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:32.499570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f718b-a62a-4da6-8dab-79cc9c8fef62 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:32.539356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:32.539996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:32.540274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:32.540552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] PATH_INFO: `/v3/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:32.542049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] RBAC: Authorizing `identity:get_role(role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:32.543465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:32.544840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 550/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:32 2022] GET /identity/v3/roles/acda13de619a41d5b6fafe2f998424fb => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:32.551139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:32.663291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66911faf-de56-4647-b3d7-da6a41e5969d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:32.712472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:32.713110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:32.713388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:32.713687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] PATH_INFO: `/v3/users/2296c7792eab4d93a875cc9943ba87bb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:32.714805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] RBAC: Authorizing `identity:get_user(user_id=2296c7792eab4d93a875cc9943ba87bb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:32.716267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:32.717921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 571/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:32 2022] GET /identity/v3/users/2296c7792eab4d93a875cc9943ba87bb => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:32.724869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:32.821442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:32.833293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1a1e-25fb-4fe1-80b6-8493c0f31f06 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:32.880916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:32.881553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:32.881825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:32.882090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:32.883351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:32.884827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c067-f4b1-4748-9871-89be08bd4e6e None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:32.886462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 551/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:32 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:32.893629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:32.923871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:33.001401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efcf3c-e4bc-43e5-bb01-0d9fc936f40a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:33.036727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:33.037386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:33.037666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:33.037940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31/users/2296c7792eab4d93a875cc9943ba87bb/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:33.040191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=e97aeaaac04d40518dcddae92e353d31, user_id=2296c7792eab4d93a875cc9943ba87bb, role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:33.041684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a012-8485-4b5d-86a2-fbddec5e3c19 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:33.056538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 572/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:32 2022] PUT /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31/users/2296c7792eab4d93a875cc9943ba87bb/roles/acda13de619a41d5b6fafe2f998424fb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:35.075962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070371-3590-412d-b5f1-828af86bbdfc None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.076573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070371-3590-412d-b5f1-828af86bbdfc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.076573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa070371-3590-412d-b5f1-828af86bbdfc None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.078010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 552/1124] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:35.086489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.087029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.087273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.108088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:35.109319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:35.186485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 573/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:35.452703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa070371-3590-412d-b5f1-828af86bbdfc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:35.564263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa070371-3590-412d-b5f1-828af86bbdfc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:35.604414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:35.605210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.605534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.605830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] PATH_INFO: `/v3/roles/acda13de619a41d5b6fafe2f998424fb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.607524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] RBAC: Authorizing `identity:get_role(role_id=acda13de619a41d5b6fafe2f998424fb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.609069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:35.611038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 553/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:35 2022] GET /identity/v3/roles/acda13de619a41d5b6fafe2f998424fb => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:35.617915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:35.637735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:35.731796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3fb75-7c89-4578-866e-52ec4434c941 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:35.768013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:35.768721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.768985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.769250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] PATH_INFO: `/v3/users/2296c7792eab4d93a875cc9943ba87bb` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.770393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] RBAC: Authorizing `identity:get_user(user_id=2296c7792eab4d93a875cc9943ba87bb)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.771874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:35.773504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 574/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:35 2022] GET /identity/v3/users/2296c7792eab4d93a875cc9943ba87bb => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:35.779534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:35.808861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:35.884438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94721a-0afb-4dbc-bb4c-ba3984f27f68 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:35.921121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:35.921741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:35.922091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:35.922368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:35.994872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:35.996348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:36.024079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:36.107681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 554/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:36.114523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:36.211064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:36.227643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64577-e08e-4342-a2ec-5c74bafafda8 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:36.265117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:36.265659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:36.265936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:36.266206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] PATH_INFO: `/v3/projects/e97aeaaac04d40518dcddae92e353d31` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:36.267463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] RBAC: Authorizing `identity:get_project(project_id=e97aeaaac04d40518dcddae92e353d31)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:36.268962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e85a-c8d0-47f8-b47f-78a42dee527a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:36.270647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 575/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:36 2022] GET /identity/v3/projects/e97aeaaac04d40518dcddae92e353d31 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:36.278722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:36.385564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec447-4155-4839-85c4-d43ce5e1d058 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:36.414421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:36.426418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:36.427494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:36.427762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:36.428051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:36.428807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] RBAC: Adding query filter params (role.id=acda13de619a41d5b6fafe2f998424fb, scope.project.id=e97aeaaac04d40518dcddae92e353d31, user.id=2296c7792eab4d93a875cc9943ba87bb) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:36.429117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:36.433167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab2289-1838-4296-a223-b1be94289f65 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:36.441942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 555/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:36 2022] GET /identity/v3/role_assignments?user.id=2296c7792eab4d93a875cc9943ba87bb&scope.project.id=e97aeaaac04d40518dcddae92e353d31&role.id=acda13de619a41d5b6fafe2f998424fb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:38.363907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02de7-c03d-4d0f-ac05-60775740d937 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:38.364443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02de7-c03d-4d0f-ac05-60775740d937 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:38.364443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02de7-c03d-4d0f-ac05-60775740d937 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:38.365744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 576/1131] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:38.371426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:38.371889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:38.371978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:38.393907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:38.395141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:38.470734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 556/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:38.743997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02de7-c03d-4d0f-ac05-60775740d937 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:38.857329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02de7-c03d-4d0f-ac05-60775740d937 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:38.894419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:38.895057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:38.895331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:38.895580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:38.896796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:38.898241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee171-7e24-4e2d-8b51-761ea3823f87 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:38.899845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 577/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:38.906044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:39.021925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f497330-f0e8-463d-a25c-f3c5d8cfacb1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:39.042876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:39.059464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:39.060090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:39.060365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:39.060663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:39.061322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:39.062773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e262dc-ae73-4521-b58e-320ccaecb685 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:39.095188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 557/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:09:38 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:41.111939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628ed5-e069-401c-a06f-fde9fcaba822 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.112514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628ed5-e069-401c-a06f-fde9fcaba822 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.112514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628ed5-e069-401c-a06f-fde9fcaba822 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.113852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 578/1135] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:41.119254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.119682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.119790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.141060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:41.142613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:41.251039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 558/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:41.519943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e628ed5-e069-401c-a06f-fde9fcaba822 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:41.550182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:41.634290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e628ed5-e069-401c-a06f-fde9fcaba822 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:41.670907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:41.671538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.671810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.672074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.673683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:41.675253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8849ae-0d17-4f93-ac14-65101d29fcc1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:41.676885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 579/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:41.682866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:41.789328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5b6c-6743-477b-b947-c2932693848e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:41.790800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:41.826877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:41.827516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:41.827817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:41.828089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:41.828755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:41.830386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ab605-d14a-4bfa-9a06-f816a8425fbc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:41.852235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 559/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:09:41 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:43.810966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5df8-8da8-4299-ac4d-85f09ac53ed5 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:43.811554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5df8-8da8-4299-ac4d-85f09ac53ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:43.811554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5df8-8da8-4299-ac4d-85f09ac53ed5 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:43.812906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 580/1139] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:43.818580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:43.819072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:43.819172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:43.838125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:43.839378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:43.913889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 560/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:44.178159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5df8-8da8-4299-ac4d-85f09ac53ed5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.288246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:44.300845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5df8-8da8-4299-ac4d-85f09ac53ed5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.336739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.337365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.337641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.337908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.348639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:44.353454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:44.354584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:44.355634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 581/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:44.361059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.451316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:44.465088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dd8b9-140b-49c8-afda-ca4a871f262a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.500208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.500858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.501132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.501472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.502176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:44.502509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:44.503882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:44.512603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 561/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:44.518780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.628117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f01c-426d-4940-8001-aeb519f093f5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.665279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.665904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.666179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.666443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] PATH_INFO: `/v3/users/78677d8d06fb498e816f40b572e8d07d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.680804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] RBAC: Authorizing `identity:get_user(user_id=78677d8d06fb498e816f40b572e8d07d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:44.682301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:44.683999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 582/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/users/78677d8d06fb498e816f40b572e8d07d => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:09:44.690549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:44.800413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa10ef-4c77-4e8b-9dfa-6d07f2b776af None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:44.835922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:44.836835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:44.836981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:44.837144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:44.856801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:44.910381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:44.911848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.015255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 562/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:45.022083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:45.034015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:45.128588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474a8c-4c15-47f2-bba8-ecb29647822f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:45.169161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:45.169789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:45.170056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:45.170325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] PATH_INFO: `/v3/projects/bd30b3c1357f426e9b988f82dc9891df` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:45.171594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] RBAC: Authorizing `identity:get_project(project_id=bd30b3c1357f426e9b988f82dc9891df)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:45.173069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312618e-40a9-4f1c-95d6-2f29b736b44c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.174997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 583/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:45 2022] GET /identity/v3/projects/bd30b3c1357f426e9b988f82dc9891df => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:45.181347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:45.236323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:45.288798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8c7f-06a9-4ddd-8be0-19bfef59907c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:45.326088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:45.326695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:45.326971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:45.327240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:45.327955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=bd30b3c1357f426e9b988f82dc9891df, user.id=78677d8d06fb498e816f40b572e8d07d) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:45.328259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:45.330171 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c48e71-b159-4c1b-8d16-36e8b77554ba None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:45.335389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 563/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:45 2022] GET /identity/v3/role_assignments?user.id=78677d8d06fb498e816f40b572e8d07d&scope.project.id=bd30b3c1357f426e9b988f82dc9891df&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:47.304385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe80ae-b0f9-446f-b9b2-9657be0c36a6 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:47.304951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe80ae-b0f9-446f-b9b2-9657be0c36a6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:47.304951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe80ae-b0f9-446f-b9b2-9657be0c36a6 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:47.306224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 584/1147] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:47.311830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:47.312266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:47.312469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:47.332848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:47.334061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:47.409637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 564/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:47.673906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe80ae-b0f9-446f-b9b2-9657be0c36a6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:47.763471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:47.789369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe80ae-b0f9-446f-b9b2-9657be0c36a6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:47.828597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:47.829237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:47.829511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:47.829750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:47.842129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:47.847430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:47.848652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:47.849797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 585/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:47.855806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:47.904334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:47.966365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9ff7a-4186-4e13-b46c-905ce20bf64b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.003210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.003833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.004114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.004386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.005091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:48.005398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.006791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.015559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 565/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:48.021998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.129315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2226e4-46c5-4193-be08-80749e240050 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.164647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.165277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.165550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.165795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] PATH_INFO: `/v3/users/78677d8d06fb498e816f40b572e8d07d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.167937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=78677d8d06fb498e816f40b572e8d07d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.169410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.171000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 586/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/users/78677d8d06fb498e816f40b572e8d07d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:48.177504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.284176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a649ffd-ad86-45d2-8a18-a96b48a49bf3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.291536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:48.321688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.322415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.322591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.322874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] PATH_INFO: `/v3/projects/bd30b3c1357f426e9b988f82dc9891df` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.324299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] RBAC: Authorizing `identity:get_project(project_id=bd30b3c1357f426e9b988f82dc9891df)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.325512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471991c-2abc-45b0-9b52-4346eb21693b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.327179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 566/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:48 2022] GET /identity/v3/projects/bd30b3c1357f426e9b988f82dc9891df => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:48.335083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:48.341365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:48.446221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f16c-f01f-40a0-ac47-62dea22e8fe4 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:48.481445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:48.482101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:48.482375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:48.482637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] PATH_INFO: `/v3/projects/bd30b3c1357f426e9b988f82dc9891df/users/78677d8d06fb498e816f40b572e8d07d/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:48.484593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd30b3c1357f426e9b988f82dc9891df, user_id=78677d8d06fb498e816f40b572e8d07d, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:48.486077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2eb50-da80-4ef4-801c-30eedb01d4f0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:48.500420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 587/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:09:48 2022] PUT /identity/v3/projects/bd30b3c1357f426e9b988f82dc9891df/users/78677d8d06fb498e816f40b572e8d07d/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:09:50.515617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15885215-4960-486a-b5f5-736f2d1dc878 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:50.516206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15885215-4960-486a-b5f5-736f2d1dc878 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:50.516206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15885215-4960-486a-b5f5-736f2d1dc878 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:50.517560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 567/1154] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:50.523360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:50.523914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:50.523914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:50.546006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:50.547185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:50.612549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:50.622435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 588/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:50.912305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15885215-4960-486a-b5f5-736f2d1dc878 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.025087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15885215-4960-486a-b5f5-736f2d1dc878 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.061999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.062635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.062911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.063178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.074226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:09:51.078973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:51.080423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:09:51.082064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:09:51.084583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 568/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:51.086855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.211285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a51bbb-67d3-420a-b2ab-352e01948e5e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.253301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.254219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.254643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.255058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.256096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:51.256658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:51.259279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:51.268615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 589/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:51.274804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.312624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.387893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db844-f4dd-49f4-acea-ecf7522f246b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.426676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.427309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.427584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.427851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] PATH_INFO: `/v3/users/78677d8d06fb498e816f40b572e8d07d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.429004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] RBAC: Authorizing `identity:get_user(user_id=78677d8d06fb498e816f40b572e8d07d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:51.430438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:51.432070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 569/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/users/78677d8d06fb498e816f40b572e8d07d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:51.438165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.500058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.549804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cc4a-70a7-47c8-8240-6f335b516af5 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.587151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.587764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.588041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.588316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.658812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:51.660273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:51.720030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.766809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 590/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:51.773182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:51.880347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509342-809b-49b0-abd7-3a15d7d5cc24 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:51.882118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:51.920022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:51.920678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:51.920953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:51.921220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] PATH_INFO: `/v3/projects/bd30b3c1357f426e9b988f82dc9891df` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:51.922370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] RBAC: Authorizing `identity:get_project(project_id=bd30b3c1357f426e9b988f82dc9891df)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:51.923809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f488dd-5f9e-4b13-b343-80315c656844 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:51.925577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 570/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/projects/bd30b3c1357f426e9b988f82dc9891df => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:51.932094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:52.040857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e81db-ad9e-4ee3-9b7e-840e77d355a7 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:52.076753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:52.077345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:52.077614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:52.077879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:52.078605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=bd30b3c1357f426e9b988f82dc9891df, user.id=78677d8d06fb498e816f40b572e8d07d) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:52.078904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:52.080352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e8783-c98e-4380-a2e3-398c7ff0a44f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:52.086352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 591/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:09:51 2022] GET /identity/v3/role_assignments?user.id=78677d8d06fb498e816f40b572e8d07d&scope.project.id=bd30b3c1357f426e9b988f82dc9891df&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:54.014964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467773-48de-413e-9f3b-977d9d826116 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:54.015523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467773-48de-413e-9f3b-977d9d826116 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:54.015523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1467773-48de-413e-9f3b-977d9d826116 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:54.017534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 571/1162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:54.026150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:54.026644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:54.026732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:54.054828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:54.056034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:54.072132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:54.131378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 592/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:54.399699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467773-48de-413e-9f3b-977d9d826116 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:54.516227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1467773-48de-413e-9f3b-977d9d826116 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:54.561080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:54.561694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:54.561972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:54.562242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:54.602468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:54.632402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:54.633893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:54.740188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 572/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:09:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:09:54.746449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:54.858345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec5e3-e5d9-4cb6-8a7b-b058f839422a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:54.899440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:54.900072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:54.900344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:54.900637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:54.907973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:54.910345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5b4c6e5a-2a6b-46a0-9f8f-39b5cc268efb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:09:54.922513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:09:54.923691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:09:54.924774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 593/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:09:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:09:54.930234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:55.007867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:55.043536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18559d-73b0-4ebe-8bf8-4a944053ce8a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:55.080965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:55.081622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:55.081881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:55.082148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:55.082829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:09:55.083141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:55.084577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2fb36-c8df-463e-820f-79f56ff11ece None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:55.092309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 573/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Aug 29 20:09:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:09:57.030275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4d81-516c-466c-87a1-59a70faccd81 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:57.030884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4d81-516c-466c-87a1-59a70faccd81 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:57.030884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4d81-516c-466c-87a1-59a70faccd81 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:57.032169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 594/1167] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:57.038212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbda8-42ff-43ce-93d9-7cfa545bb900 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:57.038765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbda8-42ff-43ce-93d9-7cfa545bb900 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:57.038765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbda8-42ff-43ce-93d9-7cfa545bb900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:57.059059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1eccbda8-42ff-43ce-93d9-7cfa545bb900 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:57.060270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1eccbda8-42ff-43ce-93d9-7cfa545bb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:57.134920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 574/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:57.401890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a4d81-516c-466c-87a1-59a70faccd81 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:57.416253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:57.512179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a4d81-516c-466c-87a1-59a70faccd81 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:09:57.546493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:09:57.547086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:57.547356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:57.547618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:57.548276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:09:57.549946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fadbdd-282f-46f3-bae0-3b7b143ff646 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:09:57.567594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 595/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Mon Aug 29 20:09:57 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:09:59.544746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07a6a-c9f1-4fc3-9875-06a7e7614b87 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:59.545349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07a6a-c9f1-4fc3-9875-06a7e7614b87 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:59.545349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe07a6a-c9f1-4fc3-9875-06a7e7614b87 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:59.546675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 575/1170] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:09:59.552274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:09:59.552789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:09:59.552789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:09:59.572576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:09:59.573820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:09:59.644792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:59.649825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 596/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:09:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:09:59.919062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe07a6a-c9f1-4fc3-9875-06a7e7614b87 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:09:59.989886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:00.030614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe07a6a-c9f1-4fc3-9875-06a7e7614b87 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:00.065983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:00.066650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:00.066914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:00.067183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] PATH_INFO: `/v3/domains/cc9be9797d3641b2bd86a86da955e203` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:00.078148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc9be9797d3641b2bd86a86da955e203)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:00.079630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb440-f7db-4d53-aec9-633b4778869d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:00.081428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 576/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Aug 29 20:09:59 2022] GET /identity/v3/domains/cc9be9797d3641b2bd86a86da955e203 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:00.087731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:00.193794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77381b55-3d72-4bd4-bf1b-f86732e82edd None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:00.231009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:00.231617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:00.231877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:00.232157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:00.232855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:00.234300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589e641-de8c-4479-bb1b-e0376c99efd1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:00.267502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 597/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:10:00 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:02.261198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4e937-7f7b-4967-8301-242bd2848914 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:02.261742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4e937-7f7b-4967-8301-242bd2848914 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:02.261742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4e937-7f7b-4967-8301-242bd2848914 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:02.263319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 577/1174] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:02.269193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:02.269672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:02.269771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:02.294220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:02.295417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:02.345821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:02.370203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 598/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:02.634377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4e937-7f7b-4967-8301-242bd2848914 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:02.746515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4e937-7f7b-4967-8301-242bd2848914 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:02.774203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:02.787224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:02.787863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:02.788144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:02.788426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] PATH_INFO: `/v3/domains/cc9be9797d3641b2bd86a86da955e203` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:02.789586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc9be9797d3641b2bd86a86da955e203)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:02.791020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b89e1-11a5-4850-b01e-0e9f58787def None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:02.792706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 578/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Aug 29 20:10:02 2022] GET /identity/v3/domains/cc9be9797d3641b2bd86a86da955e203 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:02.798635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:02.907298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eefef9-ab13-461e-81c6-6d3a96132574 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:02.950208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:02.950864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:02.951106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:02.951375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:02.952043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:02.953549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671450-0bbe-447b-b37f-84d86da97723 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:02.979158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 599/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:10:02 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:04.998750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5b2-7b51-46b6-82c1-d76c10dc3f61 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:04.999334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5b2-7b51-46b6-82c1-d76c10dc3f61 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:04.999334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5b2-7b51-46b6-82c1-d76c10dc3f61 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:05.000768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 579/1178] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:05.007178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:05.007663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:05.007663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:05.027386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:05.028621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:05.062844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:05.105674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 600/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:05.389734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4f5b2-7b51-46b6-82c1-d76c10dc3f61 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:05.504091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4f5b2-7b51-46b6-82c1-d76c10dc3f61 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:05.547669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:05.548308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:05.548620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:05.548886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:05.559870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:05.564746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:05.566971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:10:05.568529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 580/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:10:05.572587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:05.687006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbb9d8-ace8-4f2d-869a-bfd6a52240c4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:05.723727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:05.724340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:05.724655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:05.724922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:05.725598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:05.725897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:05.727298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:05.736301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 601/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:05.743854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:05.805780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:05.855611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce330e4-f6f3-4077-a0a2-164c0a7515da None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:05.894343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:05.894973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:05.895252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:05.895518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] PATH_INFO: `/v3/users/66e67b412c9245b09b438b91a3448854` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:05.909588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] RBAC: Authorizing `identity:get_user(user_id=66e67b412c9245b09b438b91a3448854)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:05.911098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:05.912815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 581/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:05 2022] GET /identity/v3/users/66e67b412c9245b09b438b91a3448854 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:05.919490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:05.954480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:06.026909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84ed8-6e63-4d17-9463-3bbc21dc3496 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:06.064073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a255a-a667-4450-a63d-17a09948463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:06.064703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a255a-a667-4450-a63d-17a09948463c None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:06.064947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a255a-a667-4450-a63d-17a09948463c None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:06.065245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a255a-a667-4450-a63d-17a09948463c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:06.140749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a255a-a667-4450-a63d-17a09948463c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:06.142207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a255a-a667-4450-a63d-17a09948463c None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:06.172639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:06.249266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 602/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:10:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:10:06.255769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:06.364699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238e81e-3b70-43ff-9b5e-6122077b46fe None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:06.375828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:06.400671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:06.401339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:06.401617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:06.401888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] PATH_INFO: `/v3/projects/c424c4924ee4490d979a9565185dd905` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:06.403109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] RBAC: Authorizing `identity:get_project(project_id=c424c4924ee4490d979a9565185dd905)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:06.404603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480f81e-c4f7-47a7-be8c-f5def30b3439 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:06.406274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 582/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:06 2022] GET /identity/v3/projects/c424c4924ee4490d979a9565185dd905 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:06.413416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a255a-a667-4450-a63d-17a09948463c None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:06.519336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a255a-a667-4450-a63d-17a09948463c None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:06.550205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:06.556946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:06.557618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:06.557943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:06.558272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:06.559063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=c424c4924ee4490d979a9565185dd905, user.id=66e67b412c9245b09b438b91a3448854) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:06.559598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:06.560911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feeec2-91a0-4977-bfc7-bdfd47970670 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:06.566732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 603/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:10:06 2022] GET /identity/v3/role_assignments?user.id=66e67b412c9245b09b438b91a3448854&scope.project.id=c424c4924ee4490d979a9565185dd905&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:08.469346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e6f3-f0a2-444d-b4b0-eb7e9ff566d2 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.469908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e6f3-f0a2-444d-b4b0-eb7e9ff566d2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.469908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42e6f3-f0a2-444d-b4b0-eb7e9ff566d2 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.471255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 583/1186] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:08.477722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.478233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.478233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.497925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:08.499118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:08.573343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 604/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:08.839960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42e6f3-f0a2-444d-b4b0-eb7e9ff566d2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:08.949964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42e6f3-f0a2-444d-b4b0-eb7e9ff566d2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:08.987195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:08.988299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:08.988299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:08.988581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:08.999725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:09.005322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:09.006673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:10:09.007753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 584/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:10:09.013302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:09.124713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccc609-0335-43f8-94da-ec049aab898a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:09.152077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:09.165156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:09.165767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:09.166037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:09.166297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:09.167005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:09.167299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:09.168686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:09.177561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 605/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:09.183757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:09.226075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:09.289146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b075-dc9d-43d2-93c4-1d793e69aaeb None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:09.330111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:09.331125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:09.331614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:09.332069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] PATH_INFO: `/v3/users/66e67b412c9245b09b438b91a3448854` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:09.334064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] RBAC: Authorizing `identity:get_user(user_id=66e67b412c9245b09b438b91a3448854)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:09.335846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:09.337514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 585/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:09 2022] GET /identity/v3/users/66e67b412c9245b09b438b91a3448854 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:09.343766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:09.462268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649c89-6ed4-4146-b7bc-b4b81619d390 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:09.496492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:09.497215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:09.497363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:09.497658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] PATH_INFO: `/v3/projects/c424c4924ee4490d979a9565185dd905` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:09.498785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] RBAC: Authorizing `identity:get_project(project_id=c424c4924ee4490d979a9565185dd905)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:09.500230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a067f84-0f42-43b1-b428-fef0355e7402 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:09.501913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 606/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:09 2022] GET /identity/v3/projects/c424c4924ee4490d979a9565185dd905 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:09.508298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:09.614811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf74f-a507-47f6-a39c-f23777fb3431 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:09.622498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:09.652080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:09.652774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:09.653048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:09.653317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] PATH_INFO: `/v3/projects/c424c4924ee4490d979a9565185dd905/users/66e67b412c9245b09b438b91a3448854/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:09.655303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] RBAC: Authorizing `identity:create_grant(project_id=c424c4924ee4490d979a9565185dd905, user_id=66e67b412c9245b09b438b91a3448854, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:09.656780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53af0b-7865-4405-8740-572c20446bcb None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:09.671670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 586/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:10:09 2022] PUT /identity/v3/projects/c424c4924ee4490d979a9565185dd905/users/66e67b412c9245b09b438b91a3448854/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:10:11.579782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425804-7649-456f-a01c-b115845f50b5 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.580422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425804-7649-456f-a01c-b115845f50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.580422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78425804-7649-456f-a01c-b115845f50b5 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.581874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 607/1193] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:11.588003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:11.588584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:11.588584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:11.607316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:11.608550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:11.696704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 587/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:10:11.976818 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78425804-7649-456f-a01c-b115845f50b5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.040269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.100182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78425804-7649-456f-a01c-b115845f50b5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.138909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.139549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.139811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.140079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.153417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:10:12.161291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:10:12.162441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:10:12.163575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 608/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:10:12.168977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.273637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.280173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fded88a-d312-4c7c-9f6c-fd0bb94060df None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.317303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.318044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.318319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.318636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.319244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:12.319543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.320956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.330028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 588/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:10:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:10:12.336152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.452855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e844f-a47e-46e6-aa10-bedc857f55da None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.467964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.490064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.490699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.490971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.491235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] PATH_INFO: `/v3/users/66e67b412c9245b09b438b91a3448854` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.492354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] RBAC: Authorizing `identity:get_user(user_id=66e67b412c9245b09b438b91a3448854)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.493815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.495423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 609/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Aug 29 20:10:12 2022] GET /identity/v3/users/66e67b412c9245b09b438b91a3448854 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:12.501793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.610034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15430eb-1b5f-4e39-ac70-50fa5170f090 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:12.647033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:12.647653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:12.647928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:12.648194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:12.679998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:12.732009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:12.733602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:12.843132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 589/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:10:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:10:12.850213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:12.962935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca366a-f8f0-4665-bef9-8287e27a0589 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:13.001977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:13.002607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:13.002881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:13.003178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] PATH_INFO: `/v3/projects/c424c4924ee4490d979a9565185dd905` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:13.004490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] RBAC: Authorizing `identity:get_project(project_id=c424c4924ee4490d979a9565185dd905)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:13.005977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da68f6-3aec-4a98-8544-ed91af7cb62e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:13.007696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 610/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Aug 29 20:10:12 2022] GET /identity/v3/projects/c424c4924ee4490d979a9565185dd905 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:13.014660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:13.101878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:13.148521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b111a-7e17-4e31-830e-4ea275e4601b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:13.186278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:13.186886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:13.187165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:13.187423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:13.188147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=c424c4924ee4490d979a9565185dd905, user.id=66e67b412c9245b09b438b91a3448854) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:13.188473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:13.189927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5039e8b-593a-48bc-a30d-4ef948b85e6c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:13.197450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 590/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:10:13 2022] GET /identity/v3/role_assignments?user.id=66e67b412c9245b09b438b91a3448854&scope.project.id=c424c4924ee4490d979a9565185dd905&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:22.996853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=75 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:23.194642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=39 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:10.748471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abb89-1bcf-469d-afc4-a86079fa0a82 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:10.748471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abb89-1bcf-469d-afc4-a86079fa0a82 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:10.748471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abb89-1bcf-469d-afc4-a86079fa0a82 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:10.750975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 611/1201] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:10.757955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:10.758642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:10.758642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:10.779187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:10.780465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:10.901444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 591/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:11:11.189023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912abb89-1bcf-469d-afc4-a86079fa0a82 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:11.330509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912abb89-1bcf-469d-afc4-a86079fa0a82 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:11.379373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:11.380037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:11.380313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:11.380644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:11.395308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:11.396826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:11.417935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:11.419387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:11.420653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:11.420653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:11.420653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:11.420653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 612/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:11.425569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:11.585456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4329-f8e6-4e8c-a927-b02b8f86c25a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:11.635007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:11.646894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:11.647658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:11.648033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:11.648344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:11.649289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:11.649921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:11.651978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac15de-2776-4f92-babd-9c2c440daf1d None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:11.668450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 592/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:11.674694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:11.763741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:11.828801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de649ad-f9e9-4f44-8fc9-5034b3e12f3b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:11.877009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:11.877637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:11.877981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:11.878491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:11.879331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:11.881031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375233-7e6e-4609-baf5-7f71eb4b7f27 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:11.906092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 613/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Aug 29 20:11:11 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:11:14.219715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2eb5d-0395-4e29-a265-c7ac185e3f15 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:14.220300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2eb5d-0395-4e29-a265-c7ac185e3f15 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:14.220300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2eb5d-0395-4e29-a265-c7ac185e3f15 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:14.221956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 593/1206] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:11:14.230801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:14.231400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:14.231400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:14.252199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:14.253454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:14.331071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 614/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:14.660820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2eb5d-0395-4e29-a265-c7ac185e3f15 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:14.803425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2eb5d-0395-4e29-a265-c7ac185e3f15 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:14.846303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:14.847049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:14.847341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:14.847618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:14.860442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:14.864633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:14.872645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:14.876060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 594/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:14.877186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:14.927761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:15.011121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c856-ed2e-4f2c-ac63-1ea9602f2709 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:15.061870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:15.062888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:15.063386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:15.063795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:15.064704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:15.065117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:15.066973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:15.080876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 615/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:15.087229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:15.149548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:15.207365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f37b27-cb09-4b2a-ae25-c6a11fe1992c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:15.244368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:15.245237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:15.245387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:15.245567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:15.256214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:15.257778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:15.273373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:15.274803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:15.275833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:15.275833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:15.275833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:15.275833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 595/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:15.281129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:15.410856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:15.415721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179b1c4-4670-4285-bc46-30ad84676591 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:15.454792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:15.455409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:15.455731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:15.456010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:15.456840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:15.457175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:15.458893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:15.472334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 616/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:15.478443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:15.591097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c6379-a7e3-45f1-9bae-0647855777d0 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:15.592929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:15.632036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:15.632036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:15.632036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:15.632036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:15.640711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:15.642179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:15.654843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:15.656094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:15.657559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:15.662827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 596/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:15.662992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:15.789590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23def91a-7917-449e-82e6-ae58d07f7bb3 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:15.837232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:15.838105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:15.838518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:15.839700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:15.840787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:15.841234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:15.842978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:15.869577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 617/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:15.870869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:15.993176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bc30-93f3-45b5-a6c3-34bed57fea81 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:16.048947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:16.049478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:16.049763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:16.050029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:16.100504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:16.157285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:16.159012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:16.281161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 597/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:16.287288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:16.308041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:16.407007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0a58-5cfc-4e89-a670-a9d9378a390e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:16.450024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:16.450708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:16.451010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:16.451245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:16.464830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:16.467455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:16.495302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:16.497414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:16.498471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:16.498471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:16.498471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:16.498471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 618/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:16.503108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:16.587302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:16.630998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca509-fe79-4d0f-bbb9-2882bdbd9e25 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:16.671449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:16.672116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:16.672460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:16.672739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:16.673443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:16.673795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:16.675385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:16.690135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 598/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:16.696042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:16.782008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:16.823051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafe47-9e12-436c-b14b-6632b149d0f1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:16.862860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:16.863507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:16.863752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:16.864009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:16.871350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:16.872891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:16.888664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:16.889751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:16.890912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 619/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:16.896050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:17.033649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914fb9-2f63-4c08-9d8a-291e6f5049af None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:17.064227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:17.079746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:17.080422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:17.080712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:17.080985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:17.081683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:17.081992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:17.083452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf50ea6-7546-460d-b26f-70ecc29707ac None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:17.100177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 599/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:17.107951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:17.254376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf8776-f528-4511-a63f-ccdd1f095a1e None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:17.287692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:17.296204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:17.296941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:17.297293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:17.297562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:17.298370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=f06b3389210c46d787994abe138ce87c) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:17.298680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:17.300131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8d735-0515-4efc-84b2-9cf0b34400d0 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:17.309480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 620/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:11:17 2022] GET /identity/v3/role_assignments?user.id=f06b3389210c46d787994abe138ce87c&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:19.349688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc23e-bf2e-4a85-8229-12abb9ed554a None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:19.350249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc23e-bf2e-4a85-8229-12abb9ed554a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:19.350249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc23e-bf2e-4a85-8229-12abb9ed554a None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:19.352110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 600/1220] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:19.359017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:19.359524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:19.359602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:19.379045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:19.380300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:19.449354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 621/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:19.723527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc23e-bf2e-4a85-8229-12abb9ed554a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:19.843734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc23e-bf2e-4a85-8229-12abb9ed554a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:19.881365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:19.882004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:19.882281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:19.882551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:19.893177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:19.898003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:19.899148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:19.900214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 601/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:19.905554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:20.029672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8848e5-3aff-42d1-aa98-be463ec97a87 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:20.064790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:20.079283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:20.079906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:20.080185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:20.080485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:20.081154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:20.081453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:20.082828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:20.092458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 622/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:20.099024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:20.153774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:20.218511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41d80a-4a48-4b90-a0ed-ab86219c7763 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:20.259899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:20.260460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:20.260737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:20.261002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:20.272902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:20.274389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:20.294474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:20.295814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:20.296875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:20.296875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:20.296875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:20.300545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 602/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:20.302381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:20.419382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3fbb-b7d4-4747-bd3e-2be35dfbdb86 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:20.463278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:20.463933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:20.464342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:20.464693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:20.465383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:20.465757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:20.467281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:20.488847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 623/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:20.490123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:20.598486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:20.608208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691f38-f99d-4b4b-86a6-0a3d74f8167a None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:20.653790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:20.654522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:20.654879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:20.655301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:20.668952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:20.671433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:20.690049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:20.691864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:20.693467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 603/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:20.698784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:20.762041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:20.825535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e704b-7ab6-423b-b15b-c8d4bd42155f None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:20.871495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:20.872264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:20.872729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:20.873126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:20.874071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:20.874540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:20.876441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:20.900806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 624/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:20.907510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:21.104704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ab6ef-ab4d-4de5-bf74-b5b44fd7d25b None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:21.157073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:21.158150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:21.158664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:21.159143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:21.177644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:21.179375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:21.199062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:21.200411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:21.201706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:21.201706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:21.201706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:21.201706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 604/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:21.206911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:21.331419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0657f-4b5a-4d9e-b8f5-89b0d450bc70 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:21.334442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:21.379935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:21.381145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:21.381430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:21.381702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:21.382356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:21.382659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:21.384048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:21.396460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 625/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:21.402600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:21.414447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:21.525175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533c98b-e68a-4dd9-808d-1d573480e657 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:21.563881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:21.564537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:21.564812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:21.565212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:21.574125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:21.575590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:21.587841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:21.588898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:21.589823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 605/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:21.596577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:21.719340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01de958-092b-4cc9-9f8d-16cd365159cb None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:21.763488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:21.764127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:21.764417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:21.764908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:21.765657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:21.766056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:21.768698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a7cd-3069-4fbe-91df-8cbc367da807 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:21.786480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 626/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:21.793747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:21.871102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:21.914537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df9b1-62d7-4259-b191-d132b6fb3550 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:21.957216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:21.957996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:21.958428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:21.958849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/f06b3389210c46d787994abe138ce87c/roles/87db888b9c6e41b7be8b82d9d08db16e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:21.983110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=f06b3389210c46d787994abe138ce87c, role_id=87db888b9c6e41b7be8b82d9d08db16e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:21.984629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6baa5-d54a-4785-8f66-cdd46a04ac89 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:21.998785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 606/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:11:21 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/f06b3389210c46d787994abe138ce87c/roles/87db888b9c6e41b7be8b82d9d08db16e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:11:23.998273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0f1f-f622-4202-b9ef-87cf4ebfbd68 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:23.998833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0f1f-f622-4202-b9ef-87cf4ebfbd68 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:23.998833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0f1f-f622-4202-b9ef-87cf4ebfbd68 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:24.000627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 627/1233] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:24.006289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:24.006817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:24.006817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:24.032406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:24.034364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:24.112743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 607/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:24.382104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0f1f-f622-4202-b9ef-87cf4ebfbd68 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:24.409887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:24.497424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c0f1f-f622-4202-b9ef-87cf4ebfbd68 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:24.535590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:24.536294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:24.536634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:24.536966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:24.547897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:24.552765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:24.553906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:24.554948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 628/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Aug 29 20:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:24.561474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:24.615629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:24.681309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468987-978b-4f72-b4da-fb3b17bcdb8d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:24.733704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:24.734329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:24.734609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:24.734914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:24.735594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] RBAC: Adding query filter params (name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:24.735909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:24.737362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:24.750587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 608/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Aug 29 20:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:24.756942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:24.883357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:24.906673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1fe9a-5ef6-4e84-9a9b-6cd9a067d1d0 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:24.951386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:24.951948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:24.952223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:24.952519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:24.966168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:24.968023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:24.988212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:24.990140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:24.991918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:24.991918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:24.991918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:24.991918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 629/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:24.995934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:25.134871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf293b-043a-4dab-91c8-98eb56321709 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:25.153158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:25.192573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:25.193658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:25.194205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:25.194548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:25.195310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:25.195594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:25.197352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:25.218532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 609/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:25.220163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:25.352602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467f4b-4977-43b2-95f1-d648e8486509 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:25.408431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:25.408431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:25.408431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:25.408431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:25.408936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:25.411454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:25.413543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:25.427234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:25.429447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:25.431754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 630/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:25.437617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:25.591009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45269-0a10-4bb0-8113-41c50728a11f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:25.631536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:25.632275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:25.632583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:25.632852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:25.633628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:25.633961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:25.635900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:25.657635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 610/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:25.663279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:25.795801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80cf3-648f-40a1-a3b3-60fa0c2c4911 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:25.850689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:25.851284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:25.851644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:25.851971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:25.934028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:25.948046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:25.949862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:26.079083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 631/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:26.085867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:26.123573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:26.220503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9dd90-79fd-4156-9fb0-11cd26cba939 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:26.272146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:26.272871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:26.273175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:26.273355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:26.286084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:26.287713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:26.306046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:26.308223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:26.309991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:26.309991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:26.309991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:26.309991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 611/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:26.313981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:26.430198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:26.437075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1c041-4ae0-4300-936d-ed0b55127b52 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:26.477409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:26.478029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:26.478334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:26.478630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:26.479397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:26.479719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:26.481314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:26.496061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 632/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:26.502041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:26.596005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:26.628746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da376f-4194-444c-bfee-a81ccd71e62c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:26.667366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:26.668029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:26.668328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:26.668628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:26.676836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:26.678463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:26.692692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:26.699328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:26.700376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 612/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:26.700925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:26.819314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66c802-7f43-4efd-94fb-a49f1eeb5e9a None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:26.862580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:26.863225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:26.863530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:26.863797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:26.864651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:26.864941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:26.866502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b4003-cb8b-454d-bd88-2adf3c0ebf02 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:26.882355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 633/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:26.889204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:27.010623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889b146-fe9c-4e02-ade1-7cde447d3b88 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:27.052316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:27.052989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:27.053273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:27.053513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:27.054313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] RBAC: Adding query filter params (role.id=87db888b9c6e41b7be8b82d9d08db16e, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=f06b3389210c46d787994abe138ce87c) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:27.054613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:27.056156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff21bb-3829-496a-8c05-8af8ed58e21c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:27.065307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 613/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:11:26 2022] GET /identity/v3/role_assignments?user.id=f06b3389210c46d787994abe138ce87c&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=87db888b9c6e41b7be8b82d9d08db16e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:29.383459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10aba-a5f5-4054-a101-c4436c5fc634 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:29.384114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10aba-a5f5-4054-a101-c4436c5fc634 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:29.384114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10aba-a5f5-4054-a101-c4436c5fc634 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:29.388264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 634/1247] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:29.394214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:29.394834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:29.394834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:29.402570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:29.418778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:29.420140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:29.508226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 614/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:29.785774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10aba-a5f5-4054-a101-c4436c5fc634 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:29.805797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:29.918976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10aba-a5f5-4054-a101-c4436c5fc634 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:29.966147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:29.967064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:29.967266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:29.967758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:29.984229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:29.990308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:29.992467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:29.994630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 635/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:30.003632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:30.149276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea067bd7-55ef-46fc-b7bb-4f6487dcd6ab None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:30.192692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:30.201799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:30.209687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:30.210189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:30.210424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:30.211419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:30.211854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:30.214440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:30.228477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 615/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:30.234929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:30.335738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:30.374920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152b499-4291-41ba-964e-19dc47c94c8d None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:30.415783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:30.417121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:30.417121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:30.417488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:30.431065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:30.433864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:30.449749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:30.451072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:30.452325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:30.452325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:30.452325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:30.452325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 636/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:30.457388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:30.582618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618473-7160-4b37-a698-5b332adf0c4f None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:30.617942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:30.618558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:30.618832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:30.619101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:30.620070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:30.620372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:30.621822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:30.634779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 616/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:30.641922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:30.769181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73095e-f44c-4fa8-967a-d426795a1b48 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:30.801089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:30.810708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:30.811441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:30.811782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:30.812102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:30.822063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:30.823939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:30.838087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:30.839778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:30.841233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 637/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:30.846392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:30.928492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:31.000267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00392-54a7-4dad-b286-48268d21ebc5 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:31.045071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:31.045630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:31.045911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:31.046178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:31.046983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:31.047351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:31.048899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:31.070563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 617/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:31.077172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:31.206266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65503-28a5-4141-af7a-5fe578b0dc57 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:31.248076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:31.248725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:31.248996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:31.249318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:31.317838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:31.340127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:31.340127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:31.469030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 638/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:31.475042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:31.596519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6e555-b86a-429e-92c6-e11a13ba1810 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:31.612148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:31.637462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80edae-6936-4096-9648-55d770570dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:31.638121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80edae-6936-4096-9648-55d770570dae None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:31.638388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80edae-6936-4096-9648-55d770570dae None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:31.638661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80edae-6936-4096-9648-55d770570dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:31.657524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80edae-6936-4096-9648-55d770570dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:31.660701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80edae-6936-4096-9648-55d770570dae None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-cf80edae-6936-4096-9648-55d770570dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:31.681353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:31.689550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:31.690836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:31.690836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:31.690836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:31.690836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 618/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:31.693068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:31.812051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:31.829265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704f02a-7c3a-4769-accb-48654bbcfeae None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:31.887662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:31.888241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:31.888565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:31.888841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:31.889541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:31.889880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:31.891332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:31.904474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 639/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:31.911629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80edae-6936-4096-9648-55d770570dae None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:32.038020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80edae-6936-4096-9648-55d770570dae None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:32.081408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:32.082048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:32.082453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:32.082598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:32.090434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:32.091980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:32.104509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:32.106262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:32.107842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 619/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:32.114010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:32.249368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d57ff-0607-4543-918f-7843bcc5d0dd None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:32.294806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:32.295490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:32.295763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:32.296054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:32.296896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:32.297249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:32.298826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d468d9-d6db-466c-89a1-c9a7db006f9f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:32.313325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 640/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:32.321647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:32.359642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:32.479041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbb6d-9e0a-4475-a41f-fc38a31de497 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:32.526357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:32.526844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:32.527121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:32.527386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:32.528111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=f06b3389210c46d787994abe138ce87c) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:32.528439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:32.529938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfcefe-a534-452c-9de6-ab38553f40cc None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:32.536252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 620/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:11:32 2022] GET /identity/v3/role_assignments?user.id=f06b3389210c46d787994abe138ce87c&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:34.563881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ba95-26a1-48f4-9ab3-067db4108e79 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:34.564496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ba95-26a1-48f4-9ab3-067db4108e79 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:34.564496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ba95-26a1-48f4-9ab3-067db4108e79 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:34.566470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 641/1261] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:34.575337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:34.575766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:34.575930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:34.599681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:34.600944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:34.689413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 621/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:11:34.983591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ba95-26a1-48f4-9ab3-067db4108e79 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:34.996134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:35.118611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ba95-26a1-48f4-9ab3-067db4108e79 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:35.159404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:35.160029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:35.160330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:35.164247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:35.173699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:35.178819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:35.179982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:35.181137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 642/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:35.187259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:35.217441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:35.311495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7856b-725f-45a7-b886-38a030b962a6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:35.352092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:35.352764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:35.353060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:35.353338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:35.354047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:35.354391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:35.355847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:35.365382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 622/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:35.371783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:35.443455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:35.481396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa098-8e85-4d6a-9280-382fe5d778c6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:35.517407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:35.518108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:35.518356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:35.518625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:35.529858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:35.531312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:35.547923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:35.549184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:35.550136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:35.550136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:35.550136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:35.550136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 643/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:35.555799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:35.650698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:35.673688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7625bc-9527-4a9c-b564-2af12dcb8905 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:35.710894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:35.711499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:35.711773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:35.712074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:35.712755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:35.713058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:35.714823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:35.727537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 623/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:35.734352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:35.850978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ced52-4bb8-4a55-8778-56f085aede69 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:35.873435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:35.888150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:35.888797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:35.889071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:35.889333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:35.896995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:35.898432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:35.911134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:35.912517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:35.914621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 644/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:35.925146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.042010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daff2bc-6348-4a97-ba9d-8a5bc70922e9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:36.084265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:36.084914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:36.085192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:36.085462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:36.086195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:36.086497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:36.087956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:36.097121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:36.105785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 624/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:36.112061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.226429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b397-a971-4e4e-86df-7f76d43aef49 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:36.262550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:36.263164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:36.263433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:36.263697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:36.274553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:36.275997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:36.290656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:36.292498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:36.293716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:36.293716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:36.293716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:36.293716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 645/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:36.299351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.420065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0866-170b-48e1-be29-4d4f7ab3d39c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:36.455813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:36.456455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:36.456756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:36.457010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:36.457654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:36.457957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:36.459347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:36.472254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 625/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:36.478211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.513069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:36.587828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772f19-8e59-497b-a1b2-f2a1a7b2c344 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:36.629857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:36.630479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:36.630750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:36.631015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:36.637950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:36.639412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:36.651692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:36.652860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:36.654604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 646/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:36.661050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.731094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:36.778089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500189ac-d3db-41c5-8b70-c6d4e5551bd4 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:36.814710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:36.815341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:36.815625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:36.815891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:36.816612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:36.816920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:36.818374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770f8bb-b0b4-4eb3-b56e-9bfc1ae8686b None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:36.831480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 626/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:36.838541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:36.963781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:36.978200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d1c82-b798-4a30-a9b8-1fb53d1f5d5b None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:37.015060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:37.015645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:37.015916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:37.016171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] PATH_INFO: `/v3/projects/941aa49cf2084b51811308b74ee0411e/users/f06b3389210c46d787994abe138ce87c/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:37.018539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] RBAC: Authorizing `identity:create_grant(project_id=941aa49cf2084b51811308b74ee0411e, user_id=f06b3389210c46d787994abe138ce87c, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:37.020000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d9cc-6aa5-4ab3-9773-17ad299ac12f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:37.039628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 647/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Aug 29 20:11:36 2022] PUT /identity/v3/projects/941aa49cf2084b51811308b74ee0411e/users/f06b3389210c46d787994abe138ce87c/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:11:38.939680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255910-b336-422c-8bad-f295f4f68ae4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:38.940655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255910-b336-422c-8bad-f295f4f68ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:38.940655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255910-b336-422c-8bad-f295f4f68ae4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:38.942675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 627/1274] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:38.949114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:38.950025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:38.950025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:38.974938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:38.976181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:39.064356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 648/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:39.346478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255910-b336-422c-8bad-f295f4f68ae4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:39.468901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255910-b336-422c-8bad-f295f4f68ae4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:39.489809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:39.508277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:39.508949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:39.509224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:39.509493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:39.520232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:11:39.525083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:39.526186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:39.528266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 628/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Aug 29 20:11:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:11:39.535732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:39.623462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:39.645168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392f7e9-ad0b-44d8-a78c-abe49426e02d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:39.682092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:39.682778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:39.683058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:39.683329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:39.683988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:39.684285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:39.685694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:39.694079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 649/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Aug 29 20:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:11:39.703394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:39.841179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d882a-e6b2-431f-947d-0cfd70bcd440 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:39.879434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c922-ec07-47db-afed-386148280774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:39.879965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c922-ec07-47db-afed-386148280774 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:39.880238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c922-ec07-47db-afed-386148280774 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:39.880530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917c922-ec07-47db-afed-386148280774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:39.891390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917c922-ec07-47db-afed-386148280774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:39.892888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917c922-ec07-47db-afed-386148280774 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-9917c922-ec07-47db-afed-386148280774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:39.906843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:39.907989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:39.908960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:39.908960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:39.908960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:39.908960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 629/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:39.916598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:40.050919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d57bb-8eab-4346-934e-b41b5b457cb8 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:40.090417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:40.091021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:40.091301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:40.091574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:40.092225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:40.092557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:40.093951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:40.107358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 650/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:40.116800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c922-ec07-47db-afed-386148280774 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:40.157034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:40.235840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917c922-ec07-47db-afed-386148280774 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:40.274411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:40.275039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:40.275319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:40.275574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:40.283677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:40.285170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:11:40.297401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:40.298538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:40.300130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 630/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:40.308042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:40.312676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:40.419224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60559407-b72c-4c43-92f0-468a05fa3ec1 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:40.457124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:40.457734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:40.458003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:40.458265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:40.459007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:40.459315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:40.460786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:40.478876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 651/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Aug 29 20:11:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:40.485216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:40.591745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:40.608874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7545-e776-4dbd-93e0-b774ceb5ab3c None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:40.665164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:40.665780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:40.666059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:40.666331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:40.746805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:40.748142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:40.847101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:40.859422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 631/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Aug 29 20:11:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:11:40.870332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:40.937771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:40.981075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c8ba8-1ac2-407f-adc0-49e43af78756 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:41.038436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:41.039224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:41.039798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:41.040122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:41.058008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:41.060016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:11:41.081599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:41.082768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:11:41.083778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:11:41.083778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:11:41.083778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:41.083778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 652/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:41.089708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:41.202574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb465775-80ef-4bff-9ec9-c1f6225e3790 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:41.242790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:41.243456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:41.243761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:41.244041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:41.244737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:41.245159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:41.247131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:41.259380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 632/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Aug 29 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:41.267803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:41.395402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0210a-8741-41ee-bbc0-be13977793b2 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:41.412878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:41.433816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:41.434441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:41.434716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:41.434983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:41.441892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:41.443286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:11:41.454657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:41.455724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: ERROR keystone.server.flask.application Aug 29 20:11:41.456700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 653/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Aug 29 20:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:41.462482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:41.528887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:41.583397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e570-de9a-43e3-8bf3-84e4c81dd962 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:41.618693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:41.619271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:41.619573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:41.619839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:41.620552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:41.620854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:41.622281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09816c-f489-48c1-af39-243852efb7f4 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:41.634273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 633/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Aug 29 20:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:41.640690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:41.765459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c1177-7cb9-4c52-9408-9ebf8ccd07a6 None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:41.801622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:41.802216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:41.802476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:41.802729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:41.803448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] RBAC: Adding query filter params (role.id=094fcef4654043758d8a01fad877074a, scope.project.id=941aa49cf2084b51811308b74ee0411e, user.id=f06b3389210c46d787994abe138ce87c) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:41.803769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:41.805240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b63b2-73ed-47a4-a4c0-025b167cffe3 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:41.812035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 654/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Aug 29 20:11:41 2022] GET /identity/v3/role_assignments?user.id=f06b3389210c46d787994abe138ce87c&scope.project.id=941aa49cf2084b51811308b74ee0411e&role.id=094fcef4654043758d8a01fad877074a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:43.800708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3db14-e818-4309-8d43-30e6171bc452 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:43.801557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3db14-e818-4309-8d43-30e6171bc452 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:43.801721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3db14-e818-4309-8d43-30e6171bc452 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:43.803871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 634/1288] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:43.813949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:43.814416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:43.814551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:43.837707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:43.838955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:43.876583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:43.923344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 655/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:44.202520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3db14-e818-4309-8d43-30e6171bc452 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.325074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3db14-e818-4309-8d43-30e6171bc452 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.336722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:44.364717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.365347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.365640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.365897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.366486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.367891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:44.377572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:44.378868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:44.379939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 635/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:11:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:44.385876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.513676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6398-510a-4912-b766-70e7350a0914 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.550749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.551350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.551623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.551888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.552563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:44.552864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.554249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1fa6f-0dda-4aea-94e9-e730cce6ef48 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:44.559360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 656/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Aug 29 20:11:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:44.566045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:44.683997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2062f-59e4-42f9-b5d4-730602e98247 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:44.721808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:44.722512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:44.722768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:44.723061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] PATH_INFO: `/v3/services` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:44.723791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:44.724110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:44.725616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2066f-0892-408e-a79d-731ff2df4ec1 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:44.731380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 636/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Aug 29 20:11:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:46.609173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7df82-3677-4e0e-b28d-541bcb9c3b66 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:46.609812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7df82-3677-4e0e-b28d-541bcb9c3b66 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:46.609812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7df82-3677-4e0e-b28d-541bcb9c3b66 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:46.611038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 657/1293] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:46.618964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1d9-193c-4f31-a186-adad28c9cf1d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:46.619392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1d9-193c-4f31-a186-adad28c9cf1d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:46.619520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc1d9-193c-4f31-a186-adad28c9cf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:46.639581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-502fc1d9-193c-4f31-a186-adad28c9cf1d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:46.640854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-502fc1d9-193c-4f31-a186-adad28c9cf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:46.672780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:46.711516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 637/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:46.979760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7df82-3677-4e0e-b28d-541bcb9c3b66 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:47.020086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:47.097232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7df82-3677-4e0e-b28d-541bcb9c3b66 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:47.133732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:47.134335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:47.134605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:47.134867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:47.135529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:47.136968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f77be6-4e72-49bf-92dc-ac32fb1af400 None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:47.158244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 658/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Aug 29 20:11:46 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:11:49.098883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679df32-bb3c-4360-a99a-4f67c04b3f8f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.099716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679df32-bb3c-4360-a99a-4f67c04b3f8f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.099716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679df32-bb3c-4360-a99a-4f67c04b3f8f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.101958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 638/1296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:49.108540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.109259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.109415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.138696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:49.139885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:49.223448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 659/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:49.490017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679df32-bb3c-4360-a99a-4f67c04b3f8f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.606288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679df32-bb3c-4360-a99a-4f67c04b3f8f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.641828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.642456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.642735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.643021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.643621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.645060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:49.655146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:49.656305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:49.657275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 639/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:49.662617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.685654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.784198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a047a4-23d5-4f89-b615-f4080a30042e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.821464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.822067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.822340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.822601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.823238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] RBAC: Adding query filter params (name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:49.823541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.825538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:49.830851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 660/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:49.837126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:49.873882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:49.953860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff4309-547a-4b8a-8c2d-d4b4c3bc5cb3 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:49.991691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:49.992309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:49.992630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:49.992904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:49.993612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] RBAC: Adding query filter params (interface=public, service_id=92a669f1b7a74ed3a5c85e3adab8e53f, region_id=RegionOne) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:49.993916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:49.995296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0efce-eb5b-4d83-96fa-e0ab61622213 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:50.001235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 640/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Aug 29 20:11:49 2022] GET /identity/v3/endpoints?service_id=92a669f1b7a74ed3a5c85e3adab8e53f&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:50.008943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:50.109534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:50.128450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6a66-3f15-409a-a915-fbf1e6fa4dce None admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:50.173401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:50.174010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:50.174285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:50.174554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:50.175161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:50.177395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5a9f2-93e2-40b5-83f7-6962eed76e8f None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:50.185771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 661/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Aug 29 20:11:50 2022] GET /identity/v3/services => generated 2191 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:11:52.188300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d935-c731-46f9-9eb5-2921a91a886d None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.188913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d935-c731-46f9-9eb5-2921a91a886d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.188913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7d935-c731-46f9-9eb5-2921a91a886d None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.190252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 641/1302] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:52.196537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.197237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.197368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.217117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:52.218322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:52.294172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 662/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:11:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:11:52.584298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7d935-c731-46f9-9eb5-2921a91a886d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:52.702031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:52.709771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7d935-c731-46f9-9eb5-2921a91a886d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:52.749093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:52.749721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.749996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.750263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.750838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:52.752207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:11:52.761526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:11:52.762867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application with Lock( Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: ERROR keystone.server.flask.application Aug 29 20:11:52.764047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 642/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Aug 29 20:11:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:11:52.768912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:52.862165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:52.886706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d7263-e3ae-43c9-a03b-2d156692d44e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:52.926034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:52.926637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:52.926881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:52.927169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] PATH_INFO: `/v3/services` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:52.927801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:11:52.928099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:52.929516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2071d-f70b-4ce1-bd40-5b7b8158d7ce None admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:52.935984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 663/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Aug 29 20:11:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:11:52.942634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:53.062990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533134-7111-46e9-9e09-a95966fbe6b9 None admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:53.105345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:53.105978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:53.106272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:53.106557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:53.107426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:53.109507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85d0f2-433f-43cc-88c2-07d8455380ab None admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:53.130275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 643/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:11:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:12:02.931812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=30 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:03.125658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:01.409939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62ece-a352-49f8-ae40-80365ca019c6 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:01.411231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62ece-a352-49f8-ae40-80365ca019c6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:01.411717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62ece-a352-49f8-ae40-80365ca019c6 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:01.417873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 664/1307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:01.419948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235537-350f-49a7-879a-8b39ec1898a7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:01.420445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235537-350f-49a7-879a-8b39ec1898a7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:01.420745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7235537-350f-49a7-879a-8b39ec1898a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:01.581456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a7235537-350f-49a7-879a-8b39ec1898a7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:01.583072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a7235537-350f-49a7-879a-8b39ec1898a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:01.726565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 644/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:13:02.051582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:02.051899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:02.052159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:02.054081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 665/1309] 10.222.0.20 () {54 vars in 965 bytes} [Mon Aug 29 20:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:02.062756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba0b2-83d7-4e79-afa1-90fabb2a48a8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:02.063175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba0b2-83d7-4e79-afa1-90fabb2a48a8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:02.063552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba0b2-83d7-4e79-afa1-90fabb2a48a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:02.163253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-229ba0b2-83d7-4e79-afa1-90fabb2a48a8 None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:02.164842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-229ba0b2-83d7-4e79-afa1-90fabb2a48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:02.193234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:02.271183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 645/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Aug 29 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:02.280660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:02.282514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:02.430154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f0418-2ad1-4d6c-a5a0-f4e828ab3b00 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:02.521811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:02.522435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:02.522714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:02.522964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:02.524675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:02.600788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:02.682475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:02.683838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3cba9-a5a0-4653-af0a-c20a63115212 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:02.706399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 666/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:05.189985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:05.191509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:05.191509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:05.192516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 646/1312] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:13:05.198050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4531-af22-4126-bade-ec186a8f523c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:05.198534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4531-af22-4126-bade-ec186a8f523c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:05.198614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4531-af22-4126-bade-ec186a8f523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:05.309502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-59bd4531-af22-4126-bade-ec186a8f523c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:05.311000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-59bd4531-af22-4126-bade-ec186a8f523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:05.449735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 667/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:05.740698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:05.740698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:05.869609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edf329-b13e-4c8e-983d-ee574ee386f5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:05.948022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:05.950654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:05.951552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:05.952382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:05.952682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:05.954429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:06.079226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:06.097040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47caf2c-bc61-48c9-8a3b-48f2f7c6c4c5 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:06.104021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 647/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:08.365962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:08.366511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:08.366511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:08.368421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 668/1315] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:08.376203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aedc7e-8023-4cbb-969a-61347d5590bb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:08.376638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aedc7e-8023-4cbb-969a-61347d5590bb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:08.376787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aedc7e-8023-4cbb-969a-61347d5590bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:08.446673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f9aedc7e-8023-4cbb-969a-61347d5590bb None None] MFA Rules not processed for user `ab915a38b89e4af49060b218b2868091`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:08.447914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f9aedc7e-8023-4cbb-969a-61347d5590bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:08.505860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:08.551972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 648/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:13:08.835849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:08.837658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:08.848616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:08.956504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f452-44e0-40b1-af2e-34e4d10ee914 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:09.037738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:09.038348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:09.038624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:09.038885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:09.040975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:09.111001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:09.171593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:09.174030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fa682-598d-4ad0-8ed2-a57cd9194cee service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:09.195811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 669/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:11.893980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183302-61be-4300-a19d-8aa4f020caea None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:11.894632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183302-61be-4300-a19d-8aa4f020caea None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:11.894902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183302-61be-4300-a19d-8aa4f020caea None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:11.896334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 649/1318] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:11.902934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17f33-2d67-494e-be41-071e009f79ec None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:11.903498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17f33-2d67-494e-be41-071e009f79ec None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:11.903498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17f33-2d67-494e-be41-071e009f79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:11.993272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e7f17f33-2d67-494e-be41-071e009f79ec None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:11.995240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e7f17f33-2d67-494e-be41-071e009f79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:12.117438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 670/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:12.412181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:12.412507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:12.412856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:12.414316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 650/1320] 10.222.0.20 () {54 vars in 965 bytes} [Mon Aug 29 20:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:12.421853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd5cb-b370-405f-a808-2d8ceefe81bb None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:12.422168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd5cb-b370-405f-a808-2d8ceefe81bb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:12.422441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd5cb-b370-405f-a808-2d8ceefe81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:12.451512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:12.524108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e60fd5cb-b370-405f-a808-2d8ceefe81bb None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:12.526776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e60fd5cb-b370-405f-a808-2d8ceefe81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:12.617354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 671/1321] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Aug 29 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:12.626631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:12.628264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:12.762997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0590-a16e-4b17-9bf9-1907101cdf2f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:12.845932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:12.846565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:12.846843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:12.847106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:12.849290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:12.857366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:12.968301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:12.969795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c132520-e985-4372-85ef-1789f01835ad service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:12.989288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 651/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:16.099017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:16.099641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:16.099641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:16.101010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 672/1323] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:16.106940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645f6f-0c0c-4869-8ca5-e7a568e60cfc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:16.107501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645f6f-0c0c-4869-8ca5-e7a568e60cfc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:16.107501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0645f6f-0c0c-4869-8ca5-e7a568e60cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:16.189430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a0645f6f-0c0c-4869-8ca5-e7a568e60cfc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:16.190681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a0645f6f-0c0c-4869-8ca5-e7a568e60cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:16.259882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:16.308975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 652/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:16.590655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:16.592204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:16.731763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0c826-d034-44cf-aaed-01feb4a90402 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:16.745815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:16.810925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:16.811533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:16.811808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:16.812083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:16.813713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:16.934268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:16.935810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7596ce-dbaf-4958-ab61-4c8a35f97099 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:16.955985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 673/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:19.001767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:19.002345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:19.002345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:19.003735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 653/1326] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:13:19.010259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ebfe-89e5-4b73-9ee0-eb0907a9b9f4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:19.010869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ebfe-89e5-4b73-9ee0-eb0907a9b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:19.010869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ebfe-89e5-4b73-9ee0-eb0907a9b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:19.086882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:19.113213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0518ebfe-89e5-4b73-9ee0-eb0907a9b9f4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:19.114547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0518ebfe-89e5-4b73-9ee0-eb0907a9b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:19.243781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 674/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:19.530738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:19.532353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:19.691319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73f29c-7e6a-40a6-9985-ab18c0b180d4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:19.792539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:19.793111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:19.793384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:19.793646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:19.796680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:19.820373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:19.955187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:19.956700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65401e7b-720e-45a1-a0fe-81c7b8fa0135 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:19.983152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 654/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:22.028592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:22.029197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:22.029197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:22.030717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 675/1329] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:22.037669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fdd4c-a3ec-46e6-8aa3-a1ec0f53e082 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:22.038246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fdd4c-a3ec-46e6-8aa3-a1ec0f53e082 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:22.038246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fdd4c-a3ec-46e6-8aa3-a1ec0f53e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:22.115345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-807fdd4c-a3ec-46e6-8aa3-a1ec0f53e082 None None] MFA Rules not processed for user `ab915a38b89e4af49060b218b2868091`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:22.116600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-807fdd4c-a3ec-46e6-8aa3-a1ec0f53e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:22.192588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:22.229847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 655/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:22.516552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:22.518148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:22.630890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0878351-481a-482c-827f-46bf3281b4b3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:22.651936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:22.713131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:22.713740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:22.714012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:22.714274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:22.715889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:22.859592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:22.861133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a97a-8dab-4c2a-b536-8360f6714f48 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:22.882923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 676/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:25.818141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:25.818758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:25.818758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:25.820062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 656/1332] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:25.825759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455e36-e827-4f0e-9dd7-c6ec547bf9d1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:25.826300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455e36-e827-4f0e-9dd7-c6ec547bf9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:25.826300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44455e36-e827-4f0e-9dd7-c6ec547bf9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:25.918116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:25.922614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-44455e36-e827-4f0e-9dd7-c6ec547bf9d1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:25.924994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-44455e36-e827-4f0e-9dd7-c6ec547bf9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:26.079468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 677/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:26.356567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:26.358154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:26.472602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d5527-e933-46a0-9012-82d2b1ffb129 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:26.548910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:26.549527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:26.549805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:26.550076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:26.552337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:26.579675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:26.672976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:26.674455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a48eb-4006-402f-9df9-3b9f733c854b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:26.695205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 657/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:28.714873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:28.715471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:28.715471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:28.717646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 678/1335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:28.723419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9019a-708e-490e-9b37-6eb584be493a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:28.724037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9019a-708e-490e-9b37-6eb584be493a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:28.724037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9019a-708e-490e-9b37-6eb584be493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:28.801154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f4f9019a-708e-490e-9b37-6eb584be493a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:28.802825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f4f9019a-708e-490e-9b37-6eb584be493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:28.883455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:28.908057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 658/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:29.194195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:29.195729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:29.308166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede42c8-da86-4bb9-a2be-fbd115cead5f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:29.338547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:29.390402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:29.391013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:29.391284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:29.391547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:29.393170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:29.516817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:29.518280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2331c37-26f7-46e8-8b96-c6a869008485 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:29.537752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 679/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:13:31.939839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:31.940503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:31.940503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:31.941788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 659/1338] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:31.947570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ba9b-a59b-4661-b6a6-638253bf5188 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:31.948157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ba9b-a59b-4661-b6a6-638253bf5188 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:31.948157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ba9b-a59b-4661-b6a6-638253bf5188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:32.022741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3fc7ba9b-a59b-4661-b6a6-638253bf5188 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:32.024051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3fc7ba9b-a59b-4661-b6a6-638253bf5188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:32.033187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:32.132634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 680/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:32.410851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:32.412505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:32.526812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d235-49a1-4000-85b0-e2c509393953 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:32.606417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:32.607212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:32.607589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:32.607954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:32.609753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:32.649586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:32.731514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:32.732999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cc6e6-43a9-47fe-b996-d513eb5d4b10 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:32.753711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 660/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:36.750035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:36.750660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:36.750660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:36.751985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 681/1341] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:36.758091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc298-efb1-4870-9dbe-4f323d59e4fb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:36.758645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc298-efb1-4870-9dbe-4f323d59e4fb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:36.758645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fc298-efb1-4870-9dbe-4f323d59e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:36.831616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-209fc298-efb1-4870-9dbe-4f323d59e4fb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:36.832855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-209fc298-efb1-4870-9dbe-4f323d59e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:36.922676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:36.936004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 661/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:13:37.220011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:37.221585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:37.337119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1620b5-3c74-454e-ba02-5bb0760c7ebd None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:37.378405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:37.417837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:37.418421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:37.418697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:37.418998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:37.420627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:37.537436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:37.539002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b806614-fe9b-4c3e-96e1-fc1a9c509976 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:37.558577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 682/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:40.375533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:40.376083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:40.376083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:40.377472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 662/1344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:40.383315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92e59-0ec8-497c-95b4-9ced99e8bf47 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:40.384065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92e59-0ec8-497c-95b4-9ced99e8bf47 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:40.384065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f92e59-0ec8-497c-95b4-9ced99e8bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:40.465248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-05f92e59-0ec8-497c-95b4-9ced99e8bf47 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:40.466467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-05f92e59-0ec8-497c-95b4-9ced99e8bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:40.488332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:40.580987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 683/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:40.876529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:40.877897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:41.001077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c453e5-0e05-465c-9ef1-9251f3621f12 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:41.090701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:41.091225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:41.091488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:41.091754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:41.093395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:41.140708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:41.220219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:41.221741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e506-3d18-4246-b422-a0dc4fc54e0d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:41.242359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 663/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:45.609058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:45.609624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:45.609740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:45.611098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 684/1347] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:45.616880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e02d-06c9-4be9-bef1-c748078e136f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:45.617385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e02d-06c9-4be9-bef1-c748078e136f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:45.617385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36e02d-06c9-4be9-bef1-c748078e136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:45.692600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0b36e02d-06c9-4be9-bef1-c748078e136f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:45.693809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b36e02d-06c9-4be9-bef1-c748078e136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:45.845224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:45.847606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 664/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:46.145922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:13:46.149539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:46.271595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caed5a7-c45e-4505-a5e6-ec4390b24b6c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:13:46.329168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:46.358944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:13:46.359589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:46.359847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:46.360103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:46.361731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:46.482999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:13:46.484529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb26ad1-33a1-49dc-b268-1eceedda1087 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:13:46.506086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 685/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:13:51.622056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5142c-ff66-4ed6-90a2-cef7650e631e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:51.622583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5142c-ff66-4ed6-90a2-cef7650e631e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:51.623110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5142c-ff66-4ed6-90a2-cef7650e631e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:51.626227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 665/1350] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:51.634251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617a9a-58d0-4c6d-9039-edf1367448d8 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:51.634933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617a9a-58d0-4c6d-9039-edf1367448d8 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:51.635555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617a9a-58d0-4c6d-9039-edf1367448d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:51.766420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f0617a9a-58d0-4c6d-9039-edf1367448d8 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:51.768524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f0617a9a-58d0-4c6d-9039-edf1367448d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:51.808277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:51.933767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 686/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:56.695657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5e6c-b696-41e5-af09-e715cc0ff38b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:56.696862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5e6c-b696-41e5-af09-e715cc0ff38b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:56.697335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5e6c-b696-41e5-af09-e715cc0ff38b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:56.699354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 666/1352] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:56.705558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56e72-81b9-4e8b-bd78-7b542506eb09 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:56.706136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56e72-81b9-4e8b-bd78-7b542506eb09 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:56.706136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea56e72-81b9-4e8b-bd78-7b542506eb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:56.804024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1ea56e72-81b9-4e8b-bd78-7b542506eb09 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:56.805626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1ea56e72-81b9-4e8b-bd78-7b542506eb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:56.892006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:13:56.935692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 687/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:13:58.746415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad1c2-07b1-444e-954d-2d9d243b4cde None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:58.747231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad1c2-07b1-444e-954d-2d9d243b4cde None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:58.747231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad1c2-07b1-444e-954d-2d9d243b4cde None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:58.748742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 667/1354] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:13:58.754940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086aa8d-4646-4aee-a066-c70e9d93ea59 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:13:58.755446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086aa8d-4646-4aee-a066-c70e9d93ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:13:58.755886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086aa8d-4646-4aee-a066-c70e9d93ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:13:58.881302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6086aa8d-4646-4aee-a066-c70e9d93ea59 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:13:58.882507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6086aa8d-4646-4aee-a066-c70e9d93ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:13:59.019206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 688/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:03.533632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaae02-273f-4d9f-9ff7-fb08100bdbd7 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.534382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaae02-273f-4d9f-9ff7-fb08100bdbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.534382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaae02-273f-4d9f-9ff7-fb08100bdbd7 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.536146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 668/1356] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:03.546480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f521fe-4854-4f7a-aa70-eaaa19c29a83 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.547261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f521fe-4854-4f7a-aa70-eaaa19c29a83 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.547261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f521fe-4854-4f7a-aa70-eaaa19c29a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.624145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.710472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a9f521fe-4854-4f7a-aa70-eaaa19c29a83 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:03.712116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a9f521fe-4854-4f7a-aa70-eaaa19c29a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:03.945395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 689/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:04.334584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.335686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.336311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.338335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 669/1358] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 29 20:14:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:04.349688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad1e9-850e-4fe1-a594-19de56335640 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.351158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad1e9-850e-4fe1-a594-19de56335640 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.351935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad1e9-850e-4fe1-a594-19de56335640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.515330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7c3ad1e9-850e-4fe1-a594-19de56335640 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:04.517924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7c3ad1e9-850e-4fe1-a594-19de56335640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:04.626241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:04.741385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 690/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Aug 29 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:04.753725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.755896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.010061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215470-6c05-422c-b542-9bf18a875a64 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:05.174380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:05.266302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:05.267434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.268047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.268707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.271734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.460214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:05.463904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652593-078d-4e48-8585-f2fe87640f10 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:05.502299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 670/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:08.773976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:08.773976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:08.777710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:08.784480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 691/1361] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:08.786162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9c5b-aff8-465a-bc64-440211da2053 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:08.786162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9c5b-aff8-465a-bc64-440211da2053 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:08.786162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9c5b-aff8-465a-bc64-440211da2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:08.892328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a9cf9c5b-aff8-465a-bc64-440211da2053 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:08.892328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a9cf9c5b-aff8-465a-bc64-440211da2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:08.939484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:09.062734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 671/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:09.610110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:09.612978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:09.931167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60541033-3c3f-459e-8a80-49403ea8b70b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:09.943724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.138111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:10.138111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:10.138483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:10.138680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:10.141801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:10.324330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:10.326333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bc9a6-e2a6-4b8b-9c0e-968f2918b030 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:10.360030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 692/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:13.885955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e869-b813-4816-93d8-aba1dea878bc None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:13.886821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e869-b813-4816-93d8-aba1dea878bc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:13.886821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e869-b813-4816-93d8-aba1dea878bc None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:13.889800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 672/1364] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:13.895824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fc85-d748-4b9a-a307-586016293e6c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:13.896645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fc85-d748-4b9a-a307-586016293e6c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:13.896831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fc85-d748-4b9a-a307-586016293e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:13.917736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:13.999675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a509fc85-d748-4b9a-a307-586016293e6c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:14.001532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a509fc85-d748-4b9a-a307-586016293e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:14.176687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 693/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:14.744303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0127f1-4931-4f59-86fb-7753189bf0f3 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.745651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0127f1-4931-4f59-86fb-7753189bf0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.745651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0127f1-4931-4f59-86fb-7753189bf0f3 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.749585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 673/1366] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 29 20:14:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:14.763887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.764692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.765114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.883042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:14.884693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:14.898994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a055-0f99-49f2-92e2-71248d5ff884 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.899877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a055-0f99-49f2-92e2-71248d5ff884 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.899877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997a055-0f99-49f2-92e2-71248d5ff884 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.901524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 674/1367] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:14.918065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc2ca-ff30-4b06-9965-e529b28af38a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.919147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc2ca-ff30-4b06-9965-e529b28af38a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.920191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc2ca-ff30-4b06-9965-e529b28af38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.958329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:15.054470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7b1cc2ca-ff30-4b06-9965-e529b28af38a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:15.057025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7b1cc2ca-ff30-4b06-9965-e529b28af38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:15.126287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 694/1368] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Aug 29 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:15.135701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:15.147422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe5fb5-bfe1-4304-83ac-101ba48744de None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:15.214639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 675/1369] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:15.328204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:15.328760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:15.329068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:15.329335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:15.331237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:15.355778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:15.468067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:15.471216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd38702-eda6-4bac-807e-a587b06ac47c service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:15.500851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 695/1370] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:15.956100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:15.957004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:15.957192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:15.960367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 676/1371] 10.222.0.20 () {54 vars in 964 bytes} [Mon Aug 29 20:14:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:15.970163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315011-fa46-4751-b9de-b8b5153533fc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:15.970870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315011-fa46-4751-b9de-b8b5153533fc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:15.971376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315011-fa46-4751-b9de-b8b5153533fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:16.146312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-65315011-fa46-4751-b9de-b8b5153533fc None None] MFA Rules not processed for user `98ae38cdd87144379c63a95dfa9bb9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:16.147594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-65315011-fa46-4751-b9de-b8b5153533fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:16.352895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 696/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Aug 29 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:16.371053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:16.376479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:16.423423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:16.664742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd69ed-72f6-424b-8d5a-c9d71a3b940c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:16.800001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:16.800910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:16.801218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:16.801494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:16.803314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:16.918107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:16.987433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:16.990149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625730-b187-4dc1-a111-b70b2b2a9fa9 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.014937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 677/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:18.365270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.365837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.365933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.367579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 697/1374] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:18.374580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6dde3-a60f-451a-9b35-26b46d1199f9 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.375409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6dde3-a60f-451a-9b35-26b46d1199f9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.375409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6dde3-a60f-451a-9b35-26b46d1199f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.461534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-20f6dde3-a60f-451a-9b35-26b46d1199f9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:18.463401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-20f6dde3-a60f-451a-9b35-26b46d1199f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.595786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 678/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:18.946613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:18.948560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.959262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:19.198646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1fbc3-265d-41aa-8aa2-22aa088d3c25 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.352154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:19.423347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.424989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.425360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.425672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.428072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.585798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.588951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16aa08-828f-4ff6-b457-ae922d60e889 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.618399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 698/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:22.141281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.142308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.142308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.143660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 679/1377] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:22.149411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36caed-ffbc-4fd8-b41a-1c2fa2f41a7a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.150191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36caed-ffbc-4fd8-b41a-1c2fa2f41a7a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.150191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36caed-ffbc-4fd8-b41a-1c2fa2f41a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.261638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-db36caed-ffbc-4fd8-b41a-1c2fa2f41a7a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:22.267603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-db36caed-ffbc-4fd8-b41a-1c2fa2f41a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:22.333033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:22.499422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 699/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:23.060964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:23.064142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.138100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:23.362378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef08210-99cd-4fee-b8ef-aee39aac1b86 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:23.587814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:23.615045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:23.615934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.616450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.617326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:23.620687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.825694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:23.829043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbe7ad-970a-4dbf-b26b-58d7a7dfe372 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:23.868355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 680/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:26.705703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.706282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.707196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.708866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 700/1380] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:26.717218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b0f-8fa5-4194-830d-45ca373e7464 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.718714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b0f-8fa5-4194-830d-45ca373e7464 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.719258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b0f-8fa5-4194-830d-45ca373e7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.819910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a3626b0f-8fa5-4194-830d-45ca373e7464 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:26.821678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a3626b0f-8fa5-4194-830d-45ca373e7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:26.913592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:26.984641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 681/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:27.565129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:27.567243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:27.895907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94020af5-7e66-4382-b88f-1f70d8681254 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:27.938934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:28.098277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.098277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.098277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.098277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.100983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:28.246443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.248565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f26e4-4e48-4ad5-a9c8-29f8933c5566 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.275823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 701/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:31.294961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.296638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.296638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.298529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 682/1383] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:31.309958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197f1f-1e48-41c9-ac6a-265d39042212 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.310619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197f1f-1e48-41c9-ac6a-265d39042212 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.311070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51197f1f-1e48-41c9-ac6a-265d39042212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.401711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:31.461042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-51197f1f-1e48-41c9-ac6a-265d39042212 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:31.462649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-51197f1f-1e48-41c9-ac6a-265d39042212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.662683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 702/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:32.194630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:32.196169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:32.478177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148edbd-c64a-48e6-a49f-bc0616517fd9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:32.556268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:32.700251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:32.701316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:32.701823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:32.702305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:32.705487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:32.870320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:32.873644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7f7c-b083-471d-a186-dc78e4d31510 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:32.916751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 683/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:35.981823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec372-ef3b-40f2-a2fd-a54d716a0fc1 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:35.981823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec372-ef3b-40f2-a2fd-a54d716a0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:35.981823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec372-ef3b-40f2-a2fd-a54d716a0fc1 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:35.981823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 703/1386] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:35.986485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c251-83f9-4572-8527-9ed7322cf181 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:35.987222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c251-83f9-4572-8527-9ed7322cf181 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:35.987520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c251-83f9-4572-8527-9ed7322cf181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.083238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328757-fed8-432f-ba8d-7d1250cee600 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.083588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328757-fed8-432f-ba8d-7d1250cee600 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.083982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41328757-fed8-432f-ba8d-7d1250cee600 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.085823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 704/1387] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:36.093288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0333e-c820-4eb8-8489-f15b3d7c971c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.093636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0333e-c820-4eb8-8489-f15b3d7c971c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.093804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6ca3c251-83f9-4572-8527-9ed7322cf181 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:36.093967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0333e-c820-4eb8-8489-f15b3d7c971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.094973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6ca3c251-83f9-4572-8527-9ed7322cf181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.098566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:36.191755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d1b0333e-c820-4eb8-8489-f15b3d7c971c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:36.193497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d1b0333e-c820-4eb8-8489-f15b3d7c971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.256844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 684/1388] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:36.300825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:36.366707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 705/1389] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:36.731678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.732162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.732663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.735262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 685/1390] 10.222.0.20 () {54 vars in 967 bytes} [Mon Aug 29 20:14:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:36.744726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.745335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.745939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.862556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:36.864384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.902039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] MFA Rules not processed for user `3f7eb4d9e0f94dd98f3ac4790c63e540`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:36.904342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:37.053969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 706/1391] 10.222.0.20 () {58 vars in 1064 bytes} [Mon Aug 29 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:37.063499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:37.073567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea91d-2a22-41b7-b084-ecf1fed35afa None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:37.101442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:37.128339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800843-61fe-49e1-9b6a-75a4061e2367 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:37.146322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:37.190240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:37.190986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.191395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.191814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.194179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:37.316283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:37.317161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.320940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.324512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.330485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:37.376294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:37.379133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc561505-21f7-4a92-bb13-ba9d1e19f653 service glance] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:37.416343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 707/1392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:37.476094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:37.478079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fb739-6a39-4ae1-9258-0c2b9aca0d4e service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:37.487109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:37.535607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 686/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:38.653612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35105-cba3-4e16-842f-ae38da0c9a91 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.653612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35105-cba3-4e16-842f-ae38da0c9a91 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.654681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35105-cba3-4e16-842f-ae38da0c9a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.783101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3cc35105-cba3-4e16-842f-ae38da0c9a91 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:38.784335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3cc35105-cba3-4e16-842f-ae38da0c9a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:38.846445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:38.919918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 708/1394] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:38.990993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.991828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.992025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.994571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 687/1395] 10.222.0.20 () {54 vars in 943 bytes} [Mon Aug 29 20:14:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:39.002614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1005-f90c-47df-9ba5-31d094d38b0c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.003034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1005-f90c-47df-9ba5-31d094d38b0c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.003496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1005-f90c-47df-9ba5-31d094d38b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.153485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-968f1005-f90c-47df-9ba5-31d094d38b0c None None] MFA Rules not processed for user `4d2583f38c13417887002a80c64654bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:39.155711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-968f1005-f90c-47df-9ba5-31d094d38b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.356573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 709/1396] 10.222.0.20 () {58 vars in 1040 bytes} [Mon Aug 29 20:14:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:39.368527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:39.371351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.599268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0815c4-dad1-429a-9491-7cd50ddbbedb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:39.749718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:39.793046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:39.794257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.794575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.795053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.798235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.926856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:39.929690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fa897-761b-4e8f-a714-b2de12ea8fea service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:39.941897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 688/1397] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:39.965525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.966164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.966485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.968124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 710/1398] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:39.975244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4df89-081f-419a-a067-9ef53614a822 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.976286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4df89-081f-419a-a067-9ef53614a822 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.976865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4df89-081f-419a-a067-9ef53614a822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:40.085300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-75d4df89-081f-419a-a067-9ef53614a822 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:40.088087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-75d4df89-081f-419a-a067-9ef53614a822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:40.209128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:40.266594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 689/1399] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:40.648145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:40.649831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:40.657379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:40.910186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43951-4ca6-42e2-8c99-e5f53e65c25d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:41.053903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:41.122478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:41.124294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:41.124788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:41.125258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:41.128883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:41.319750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:41.323499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02a2b-72a2-4427-9fc5-330a0c3926eb service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:41.355786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 711/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:44.677541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:44.677541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:44.677541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:44.682822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 690/1401] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:44.685970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e114-8b7d-46e9-ba30-6024be5e1dd4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:44.686776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e114-8b7d-46e9-ba30-6024be5e1dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:44.687075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e114-8b7d-46e9-ba30-6024be5e1dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:44.822968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5c90e114-8b7d-46e9-ba30-6024be5e1dd4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:44.825347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5c90e114-8b7d-46e9-ba30-6024be5e1dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:44.891888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:44.986349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 712/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:45.324600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:45.326947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:45.566380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65366b-09a5-488c-ae89-6e5fefee905b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:45.651317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:45.747768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:45.748636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:45.748919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:45.749196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:45.751056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:45.885715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:45.887558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8c1b3-dced-47aa-9ce1-accca979263b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:45.913971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 691/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:48.186105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:48.187055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:48.187055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:48.188526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 713/1404] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:48.194340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29124-5f4f-4918-a5ea-c5ff41db22a4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:48.195153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29124-5f4f-4918-a5ea-c5ff41db22a4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:48.195153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc29124-5f4f-4918-a5ea-c5ff41db22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:48.291941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ffc29124-5f4f-4918-a5ea-c5ff41db22a4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:48.293366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ffc29124-5f4f-4918-a5ea-c5ff41db22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:48.299098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:48.456833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 692/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:48.762036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:48.764162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:49.015489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05057fe1-4f00-4745-8528-9594f1e35707 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:49.050206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:49.207446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:49.208512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:49.208512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:49.208812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:49.210405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:49.362554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:49.364134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ff29a-ae73-4ce6-940a-e2cc3bae94f1 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:49.392464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 714/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:52.545635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:52.546662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:52.546662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:52.548790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 693/1407] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:52.556279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26174c7-0175-4343-8d13-93d2003ca212 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:52.557203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26174c7-0175-4343-8d13-93d2003ca212 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:52.557727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26174c7-0175-4343-8d13-93d2003ca212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:52.658445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:52.719914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b26174c7-0175-4343-8d13-93d2003ca212 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:52.722262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b26174c7-0175-4343-8d13-93d2003ca212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:52.934789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 715/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:53.496092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:53.500500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:53.758315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:53.777061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b504c7b-5f17-4482-a2e2-015736f69db5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:54.005972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:54.006950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:54.007236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:54.007542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:54.009389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:54.181914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:54.183590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f1473-e62a-4c30-8117-d9f466638f48 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:54.204116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:54.245033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 694/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:02.931895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=52 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:04.219406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:06.741955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435778f-a05e-4ef5-8f0a-a45a80a3211d None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:06.742849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435778f-a05e-4ef5-8f0a-a45a80a3211d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:06.742849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435778f-a05e-4ef5-8f0a-a45a80a3211d None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:06.744416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 716/1410] 10.222.0.20 () {54 vars in 918 bytes} [Mon Aug 29 20:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:06.750961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d477-9645-4c11-bf7e-0fa2a5645334 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:06.751555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d477-9645-4c11-bf7e-0fa2a5645334 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:06.751776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d477-9645-4c11-bf7e-0fa2a5645334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:06.852017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d309d477-9645-4c11-bf7e-0fa2a5645334 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:06.853414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d309d477-9645-4c11-bf7e-0fa2a5645334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:06.996363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 695/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 29 20:15:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:07.011563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40d14-6db0-4ba9-a211-1d2d88fd758f None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:07.011841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40d14-6db0-4ba9-a211-1d2d88fd758f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:07.012111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b40d14-6db0-4ba9-a211-1d2d88fd758f None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:07.013557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 717/1412] 10.222.0.20 () {54 vars in 918 bytes} [Mon Aug 29 20:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:07.019257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbba24-fe7d-47b2-a333-044ca2734e7e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:07.019552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbba24-fe7d-47b2-a333-044ca2734e7e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:07.019829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbba24-fe7d-47b2-a333-044ca2734e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:07.113321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:07.117493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b9bbba24-fe7d-47b2-a333-044ca2734e7e None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:07.119346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b9bbba24-fe7d-47b2-a333-044ca2734e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:07.300692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 696/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Aug 29 20:15:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:09.905938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:09.907458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:09.907458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:09.909166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:09.915730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4840aa-0210-46db-a894-47dd138e4bfe None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:09.916635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4840aa-0210-46db-a894-47dd138e4bfe None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:09.916635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4840aa-0210-46db-a894-47dd138e4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.002108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0b4840aa-0210-46db-a894-47dd138e4bfe None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:10.003411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b4840aa-0210-46db-a894-47dd138e4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.071511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:10.125557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:10.430508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.432277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.653818 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fd15d-4ad6-46f3-8114-0bf31ec3ed29 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.756301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:10.814106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.814732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.815006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.815272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.817118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.946318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.947966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f657612-b364-44b4-b721-a6f56749c9ee service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.970741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 719/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:11.985424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.986026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.986026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.987340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:11.993468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77916e-d07a-4496-9a74-786eaa739386 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.994106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77916e-d07a-4496-9a74-786eaa739386 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.994229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77916e-d07a-4496-9a74-786eaa739386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.106907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-fd77916e-d07a-4496-9a74-786eaa739386 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:12.108987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fd77916e-d07a-4496-9a74-786eaa739386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.155309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.271995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:12.439820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.442725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.673402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3651bd-3b37-4c86-bce4-72067c7c67c8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.724869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.819822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.820607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.820972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.821288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.823774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.951568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.954182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1c91-b117-458a-a226-137c6044473e service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.976164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 699/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:14.011968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:14.012719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:14.012719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:14.014014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:14.020059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb612-5edf-4fd5-89d4-2a4d19bf866f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:14.020761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb612-5edf-4fd5-89d4-2a4d19bf866f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:14.020761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb612-5edf-4fd5-89d4-2a4d19bf866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:14.096999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:14.134819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-feafb612-5edf-4fd5-89d4-2a4d19bf866f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:14.136990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-feafb612-5edf-4fd5-89d4-2a4d19bf866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:14.326047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:14.504001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:14.505614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:14.706315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973cd6-9a51-4a40-82d3-dcf9be4bdc0b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:14.722846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:14.893233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:14.893844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:14.894108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:14.894370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:14.896064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.039638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:15.043111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f532bfc-64d8-4566-8efb-3beb154168fc service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:15.081644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 722/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:16.150698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.151339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.151507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.154077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:16.163637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15df14-55d3-4275-94f3-6df5288b2460 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.164214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15df14-55d3-4275-94f3-6df5288b2460 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.164214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15df14-55d3-4275-94f3-6df5288b2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.193330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.262419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ff15df14-55d3-4275-94f3-6df5288b2460 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:16.263655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ff15df14-55d3-4275-94f3-6df5288b2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.385305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:16.542632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.544090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.696624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.763774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f4575-a694-4d58-8f9f-77c4b029a81b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.973620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.974238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.974514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.974778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.976556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:17.084849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:17.111842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.113631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f97616-4cc8-4438-b456-812fc824f63d service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.139714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 702/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:18.141110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.141905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.141905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.143204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:15:18.149258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0453-0418-4a58-9bc4-df35913f53d3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.150121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0453-0418-4a58-9bc4-df35913f53d3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.150121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0453-0418-4a58-9bc4-df35913f53d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.262886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bf9d0453-0418-4a58-9bc4-df35913f53d3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:18.264282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bf9d0453-0418-4a58-9bc4-df35913f53d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.422984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:18.584812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.586418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.701776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:18.789378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e9c4-336f-43ca-8948-ec528cf82e62 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:18.929439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:18.930038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.930309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.930574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.932214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.991104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:19.040237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:19.041902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f06a2-7148-41a1-93b1-5ee1e6a0fa6d service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:19.064261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 725/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:19.914132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.914790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.914790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.916056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:19.922333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d93a4-f436-4bff-98f3-ffca424784d6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.922917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d93a4-f436-4bff-98f3-ffca424784d6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.923107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d93a4-f436-4bff-98f3-ffca424784d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.023186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-048d93a4-f436-4bff-98f3-ffca424784d6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:20.024507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-048d93a4-f436-4bff-98f3-ffca424784d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.152671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:20.333136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.334735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.394209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.534204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d5bf-0718-40bd-980e-f3dee12f14fd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.726617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.727263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.727542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.727812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.729570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.740003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.868127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.870467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbf762-32f4-4222-8309-032912fe5894 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.894355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 705/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:21.820038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.820690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.820903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.822803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:21.830081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e23ad-8701-45ad-864a-35741d8679ac None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.830678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e23ad-8701-45ad-864a-35741d8679ac None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.830806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e23ad-8701-45ad-864a-35741d8679ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.955759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-206e23ad-8701-45ad-864a-35741d8679ac None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:21.957078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-206e23ad-8701-45ad-864a-35741d8679ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.052708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:22.087442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:22.256370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:22.258230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.278256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:22.467266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7b417-6ebf-44ce-8adb-40eee931216f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:22.614395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:22.673310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:22.674443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.674927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.675414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.679195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.858290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.861681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c810fc-00f2-49a9-868f-729b81871835 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.901060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 728/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:23.772067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.772792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.772792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.774143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:23.781011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c3ebe-9d62-441f-b536-747185fb6f57 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.781486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c3ebe-9d62-441f-b536-747185fb6f57 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.782028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c3ebe-9d62-441f-b536-747185fb6f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.914334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ab6c3ebe-9d62-441f-b536-747185fb6f57 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:23.916042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ab6c3ebe-9d62-441f-b536-747185fb6f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:23.974210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:24.040078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:24.199945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.201597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.377361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00168a-e8ce-4175-b341-437eb7ac7dd2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.443069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:24.556931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.557562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.557979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.558221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.559925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.670384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.672063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a668-1752-4be0-8dfa-82bb497fea5f service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.694887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 708/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:25.591397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.593058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.593058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.594019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:15:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:25.600303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c79cf-6275-4fc6-85ca-296f4d1da6d7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.600999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c79cf-6275-4fc6-85ca-296f4d1da6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.600999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c79cf-6275-4fc6-85ca-296f4d1da6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.709006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-720c79cf-6275-4fc6-85ca-296f4d1da6d7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:25.710271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-720c79cf-6275-4fc6-85ca-296f4d1da6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:25.712837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:25.858162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:26.037870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.039482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:26.289298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772259c3-a515-49f7-a5d5-5b38214fa0ab None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.329265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:26.515817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.517884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.518474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.518796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.522116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:26.727748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.730807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32588b3-1ea6-4142-a57f-8ef81d5a77c9 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.762583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 731/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:28.867720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.868623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.868623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.870133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:15:28.877225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590559-f35c-4cb6-ba7c-2dada561c1fd None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.877225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590559-f35c-4cb6-ba7c-2dada561c1fd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.878436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a590559-f35c-4cb6-ba7c-2dada561c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.936304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:28.987300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4a590559-f35c-4cb6-ba7c-2dada561c1fd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:28.989407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4a590559-f35c-4cb6-ba7c-2dada561c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:29.149003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:29.487168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:29.488774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:29.617815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffa6d5-e6cd-45ce-a5be-549bfd5cbe9f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:29.662066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:29.724004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:29.724702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:29.724985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:29.725209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:29.726866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:29.863780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:29.865479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fbfb-a85e-4caa-86a0-fafed7929af3 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:29.887074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 711/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:32.101780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.102464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.102464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.103618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:15:32.109786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2455-17ec-41c9-a26f-1d34309423bd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.110632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2455-17ec-41c9-a26f-1d34309423bd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.110632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed2455-17ec-41c9-a26f-1d34309423bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.189393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5fed2455-17ec-41c9-a26f-1d34309423bd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:32.190650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5fed2455-17ec-41c9-a26f-1d34309423bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:32.205216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:32.306102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:32.674526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:32.676169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:32.827166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500bd3-197d-4caa-a20d-b6f6bf4c8988 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:32.842008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:32.919535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:32.920514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.920777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.921188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.923131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:33.084875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:33.086404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94376a4-eb58-4d3e-b21f-18adef79a720 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:33.107513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 734/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:35.696332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.697157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.697157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.698303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:35.704490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3254-7d53-4066-b823-b23b605cf51d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.705452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3254-7d53-4066-b823-b23b605cf51d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.705452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3254-7d53-4066-b823-b23b605cf51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.761611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:35.786270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-901d3254-7d53-4066-b823-b23b605cf51d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:35.787100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-901d3254-7d53-4066-b823-b23b605cf51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.921985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.211604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.213242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.383982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b06288-9ed6-47bc-90e0-6b59d09a0794 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.459103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:36.508532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.509162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.509434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.509701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.511337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.635877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.637252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f08f1-973b-4ddb-bce6-2be28aee680a service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.657396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 714/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:39.049082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.049082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.050233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.051331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:39.057950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea66d-7bf6-40c1-ad56-cd673d7d78f7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.058562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea66d-7bf6-40c1-ad56-cd673d7d78f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.058562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fea66d-7bf6-40c1-ad56-cd673d7d78f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.141261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-16fea66d-7bf6-40c1-ad56-cd673d7d78f7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.142612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-16fea66d-7bf6-40c1-ad56-cd673d7d78f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.169732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.262988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:39.555339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.557113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.673829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc57d4e-3832-469e-9157-f98c18c82da1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.698001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.764183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.764833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.765108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.765372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.767197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.901986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.903582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb2dcd-6ff5-41fb-b6d0-887434751794 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.926954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 737/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:42.101821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.102401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.102401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.103644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:15:42.109450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466fbd-42bb-4f0b-8ea9-bf72d7b8ea7a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.109988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466fbd-42bb-4f0b-8ea9-bf72d7b8ea7a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.109988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466fbd-42bb-4f0b-8ea9-bf72d7b8ea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.184907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:42.189794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f7466fbd-42bb-4f0b-8ea9-bf72d7b8ea7a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:42.193070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f7466fbd-42bb-4f0b-8ea9-bf72d7b8ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.381803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:42.822816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:42.825150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.989785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d78886-49a1-4bd7-b0bc-1fff9a8ce393 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.047337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:43.076714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.077239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.077517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.077776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.079391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:43.208982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.210452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d587a80-a1cc-44b0-9b28-fc89a49a1f37 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.231802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 717/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:45.306532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:45.307250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:45.307250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:45.309220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:45.315898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443a5a-a8a9-4d4e-8ac5-8b24caca9997 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:45.316508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443a5a-a8a9-4d4e-8ac5-8b24caca9997 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:45.316705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443a5a-a8a9-4d4e-8ac5-8b24caca9997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:45.402753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-86443a5a-a8a9-4d4e-8ac5-8b24caca9997 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:45.404036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-86443a5a-a8a9-4d4e-8ac5-8b24caca9997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:45.448283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:45.536250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:45.837707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:45.839273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:45.958655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ee54-94c4-45ff-9334-2d3d51517135 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:45.991517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:46.068324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:46.068879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:46.069170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:46.069442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:46.071149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:46.207095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:46.208592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263194f-1288-41c6-afaf-3b17326f82fa service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:46.231030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 740/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:48.360838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.361557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.361557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.362884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:48.369170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a59ee-5e41-4243-bf3d-b2d2361f10b4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.369783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a59ee-5e41-4243-bf3d-b2d2361f10b4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.369783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a59ee-5e41-4243-bf3d-b2d2361f10b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.457481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-027a59ee-5e41-4243-bf3d-b2d2361f10b4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:48.459379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-027a59ee-5e41-4243-bf3d-b2d2361f10b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.476201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:48.583013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:48.865905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.867529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.994301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134ee4b-55f9-4c53-942b-459cc9f18304 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:49.057171 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:49.079941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:49.080602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:49.080880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:49.081916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:49.083607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:49.211112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:49.212751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7451e-de82-44e0-b63a-0119d9f089e2 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:49.232375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 720/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:51.399479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:51.400071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:51.400071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:51.401983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:51.407924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec620f-a822-46c8-8f84-2742890f18f8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:51.408385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec620f-a822-46c8-8f84-2742890f18f8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:51.408530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec620f-a822-46c8-8f84-2742890f18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:51.483043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-11ec620f-a822-46c8-8f84-2742890f18f8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:51.484258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-11ec620f-a822-46c8-8f84-2742890f18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:51.533191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:51.605463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:51.891308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:51.893049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:52.024623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a95a9e-13d6-45b6-a07d-2641f9272a6a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:52.068108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:52.121477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:52.122094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:52.122367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:52.122629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:52.124281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:52.273470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:52.275164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40def76-49f0-4dd7-8e9e-944733320754 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:52.301968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 743/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:54.384452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:54.385090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:54.385090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:54.386786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:54.393482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef7d5-f6fb-4a5d-b3b6-693bad6db715 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:54.394297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef7d5-f6fb-4a5d-b3b6-693bad6db715 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:54.394297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef7d5-f6fb-4a5d-b3b6-693bad6db715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:54.484216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b40ef7d5-f6fb-4a5d-b3b6-693bad6db715 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:54.486669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b40ef7d5-f6fb-4a5d-b3b6-693bad6db715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:54.512283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:54.611943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:54.899254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:54.900953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:55.029185 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2003eb6-a99c-42e1-a8b9-3ff442c0c145 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:55.106688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:55.115051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:55.115673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:55.115949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:55.116221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:55.117881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:55.238209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:55.239649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7553559-8eb5-48ef-9762-7eb090a71464 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:55.258198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 723/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:57.314131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:57.314778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:57.314778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:57.316731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:57.322505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb4522-ae4d-41a6-b8ee-c8d437f98692 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:57.323021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb4522-ae4d-41a6-b8ee-c8d437f98692 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:57.323134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb4522-ae4d-41a6-b8ee-c8d437f98692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:57.408923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-eddb4522-ae4d-41a6-b8ee-c8d437f98692 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:57.410516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eddb4522-ae4d-41a6-b8ee-c8d437f98692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:57.473689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:57.553123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:57.855588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:57.857450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.006761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cc60c-9d1e-4db4-993c-dc75d2700710 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.077718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:58.114202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.114952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.115251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.115530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.117310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.285755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.288669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2b4f6-b4e0-4e4c-97ed-7ca4a6da7b68 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.326911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 746/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:07.550689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=22 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:08.322345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=66 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:20.185949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9e7f-02e2-467f-a0ae-495381ce78b1 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.186580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9e7f-02e2-467f-a0ae-495381ce78b1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.186580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9e7f-02e2-467f-a0ae-495381ce78b1 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.187878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 725/1471] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:20.194367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa306-7f80-4547-9af1-5a19c8d35fca None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.194367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa306-7f80-4547-9af1-5a19c8d35fca None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.194367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aa306-7f80-4547-9af1-5a19c8d35fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.286177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8d3aa306-7f80-4547-9af1-5a19c8d35fca None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:20.287534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8d3aa306-7f80-4547-9af1-5a19c8d35fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:20.440070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 747/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:20.884455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.884739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.885012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.886416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 726/1473] 10.222.0.20 () {54 vars in 967 bytes} [Mon Aug 29 20:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:20.891882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793535-ea3f-4d01-a41f-c423e22805bc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.892186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793535-ea3f-4d01-a41f-c423e22805bc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.892500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b793535-ea3f-4d01-a41f-c423e22805bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.988527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7b793535-ea3f-4d01-a41f-c423e22805bc None None] MFA Rules not processed for user `3f7eb4d9e0f94dd98f3ac4790c63e540`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:20.989972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7b793535-ea3f-4d01-a41f-c423e22805bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:21.014473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:21.100081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 748/1474] 10.222.0.20 () {58 vars in 1064 bytes} [Mon Aug 29 20:16:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:21.109321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:21.110875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:21.241844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81fade-8896-4c0d-9ba5-dac1e78b319b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:21.326564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:21.327179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:21.327462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:21.327736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:21.329464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:21.407566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:21.498345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:21.499735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fdf01-516c-4cdb-9a95-e9524293460f service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:21.532966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 727/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:23.788282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.789103 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.789930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.791535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 749/1476] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:23.798095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d128-ad14-44ab-bfc6-98cdc3dc05c5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.798919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d128-ad14-44ab-bfc6-98cdc3dc05c5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.798919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11d128-ad14-44ab-bfc6-98cdc3dc05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.904043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1b11d128-ad14-44ab-bfc6-98cdc3dc05c5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:23.906030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1b11d128-ad14-44ab-bfc6-98cdc3dc05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.102584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 728/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:24.561747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.563482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.765706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39576e-18b9-4f6f-9390-a9c3f04dca43 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.844353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:24.931021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.931677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.931955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.932222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.932942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.934862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:16:24.934862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:16:24.934862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:16:24.936074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ed5b0-0b18-4490-9012-bd51e70c2da4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.963834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 750/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Aug 29 20:16:24 2022] GET /identity/v3/projects => generated 2553 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:27.080176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.080863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.080863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.082226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 729/1479] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:27.089306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35916bc-9775-4a0c-8d0d-e18133148720 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.090248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35916bc-9775-4a0c-8d0d-e18133148720 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.090248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35916bc-9775-4a0c-8d0d-e18133148720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.178170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f35916bc-9775-4a0c-8d0d-e18133148720 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:27.179673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f35916bc-9775-4a0c-8d0d-e18133148720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.298261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 751/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:27.623031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.625398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.644166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:27.880590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716bbc1-cb8b-4bd9-a87b-5ce3e6096ae3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.997667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:28.045446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.046323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.046604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.046876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.049313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:28.192248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.195442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902cb73-8c6a-472e-84d9-49bb2e9e89ed service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.219545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 730/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:30.524530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:30.525194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:30.525194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:30.526994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 752/1482] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:30.533946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b433-c33a-4233-bfd7-a07572c9e382 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:30.534528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b433-c33a-4233-bfd7-a07572c9e382 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:30.534743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03b433-c33a-4233-bfd7-a07572c9e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:30.621792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-aa03b433-c33a-4233-bfd7-a07572c9e382 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:30.623032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aa03b433-c33a-4233-bfd7-a07572c9e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:30.685850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:30.749353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 731/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:31.130736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:31.132558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:31.161038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:31.269154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5700c0-79c6-44a9-85a3-356e00084819 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:31.576681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:31.577475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.577680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.577948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.579645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:31.693127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:31.738899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:31.740636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1f02b-5527-47d0-839b-cb6a8beefe84 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:31.766798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 753/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:33.910778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.911345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.911345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.912942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 732/1485] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:16:33.920951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847573-7cfd-45a2-b17a-186c2592bfd5 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.921809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847573-7cfd-45a2-b17a-186c2592bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.921809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847573-7cfd-45a2-b17a-186c2592bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:34.026782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-14847573-7cfd-45a2-b17a-186c2592bfd5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:34.028962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-14847573-7cfd-45a2-b17a-186c2592bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:34.166862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 754/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:34.472573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:34.475853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:34.639018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b949-5ea6-4ff9-a04d-41b4d0d99dd0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:34.761961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:34.765876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:34.767137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:34.767652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:34.767981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:34.771548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:35.078302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:35.080418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c2747-e328-48e0-9b81-331bf8419a9c service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:35.105169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 733/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:37.398289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.398866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.399271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.401867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 755/1488] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:37.409421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d425e88-82c8-48e4-8bc5-9627eceac363 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.410047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d425e88-82c8-48e4-8bc5-9627eceac363 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.410390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d425e88-82c8-48e4-8bc5-9627eceac363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.520180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8d425e88-82c8-48e4-8bc5-9627eceac363 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:37.522645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8d425e88-82c8-48e4-8bc5-9627eceac363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:37.600868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:37.653269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 734/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:37.991177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.994048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:38.061056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:38.158225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11bff-45d8-4b0b-8d8c-801588bfee23 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:38.261817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:38.262388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:38.262710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:38.263126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:38.264947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:38.371083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:38.431364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:38.434260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1476803-d3ca-430d-bc60-7013243e555e service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:38.473770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 756/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:40.892071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.892802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.892802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.895279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 735/1491] 10.222.0.20 () {54 vars in 927 bytes} [Mon Aug 29 20:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:16:40.908758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250f6b-1da7-486a-9368-a14382b3ded9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.909372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250f6b-1da7-486a-9368-a14382b3ded9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.909372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250f6b-1da7-486a-9368-a14382b3ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.999391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-84250f6b-1da7-486a-9368-a14382b3ded9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:41.001572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-84250f6b-1da7-486a-9368-a14382b3ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:41.155315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 757/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Aug 29 20:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:41.490961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:41.492631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:41.618131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7b1c-1c77-43fe-83f2-683ef02dcc01 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:41.707024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:41.707646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:41.707911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:41.708199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:41.709852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:41.719616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:41.851790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:41.853651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406db2dc-802a-494c-b0ac-044f5fcd22fa service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:41.877735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 736/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:51.152527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=82 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:51.874601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=50 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:12.691857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.692680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.692680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.779525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:12.780770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:12.895688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 758/1494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:12.903976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.904516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.904630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.924523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:12.925733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:12.934977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 737/1495] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:12.939710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.950299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91238d7-820d-443b-8ea0-70247ff1b27e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.955799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.956468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.956743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.957004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.957655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:18:12.957951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:12.958973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:12.958973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:18:12.958973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:18:12.959854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:12.972825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 759/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:18:12.981917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:12.991893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ed3c0-d234-4188-bf97-83cb06087b83 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:12.997844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:12.998659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:12.998915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:12.999191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:12.999824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.001773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.001773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:18:13.001773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:18:13.003002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.051092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 738/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:18:12 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:18:13.057925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.068116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6abb6-1f49-4ea1-9a85-2a0cb448d4d0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.138582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.148904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.149605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.149989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.150259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.151022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.152310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.152310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:18:13.152310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:18:13.154332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.182748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 760/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:18:13.189980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.201694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02189d-2872-48c2-a8f9-98388dd7cb97 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.207320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.207998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.208323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.208722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.209456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.210537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.210537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:18:13.210537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:18:13.211524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.225993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 739/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:18:13.230487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.241615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108addc-0907-4897-ad0d-34d2e7d307d0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.246761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.248146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.248451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.248727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.249390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.250420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.250420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:18:13.250420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:18:13.251341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b208fa-4161-4d37-9be0-01b5d30902c4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.267923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 761/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:18:13.277695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.290608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f601d-3b9f-45a6-808e-8f2ad0164c01 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.296591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.297667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.297952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.298227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] PATH_INFO: `/v3/projects/2914f288bc4f4a09b6a19b10ea0fc474/users/9e1467a8bec94f359218b072e23af802/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.318725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2914f288bc4f4a09b6a19b10ea0fc474, user_id=9e1467a8bec94f359218b072e23af802, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.320037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.320037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:18:13.320037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:18:13.321807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28447c06-48b6-4411-8bec-9f7492e4a875 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.336754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 740/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:18:13 2022] PUT /identity/v3/projects/2914f288bc4f4a09b6a19b10ea0fc474/users/9e1467a8bec94f359218b072e23af802/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:13.349544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b555-9ef4-45b4-8f5c-4235485efa99 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.349834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b555-9ef4-45b4-8f5c-4235485efa99 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.350094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7b555-9ef4-45b4-8f5c-4235485efa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.379866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-68c7b555-9ef4-45b4-8f5c-4235485efa99 None None] MFA Rules not processed for user `9e1467a8bec94f359218b072e23af802`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:13.381104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-68c7b555-9ef4-45b4-8f5c-4235485efa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:13.453544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 762/1502] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:13.467403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480b368-4147-440d-b273-ac03ba9a35fd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.467652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480b368-4147-440d-b273-ac03ba9a35fd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.468073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480b368-4147-440d-b273-ac03ba9a35fd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.469556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 741/1503] 10.222.0.20 () {54 vars in 964 bytes} [Mon Aug 29 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:13.474700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da373b-b716-46ee-9376-b6198834634e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.474988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da373b-b716-46ee-9376-b6198834634e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.475258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da373b-b716-46ee-9376-b6198834634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.537480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-45da373b-b716-46ee-9376-b6198834634e None None] MFA Rules not processed for user `98ae38cdd87144379c63a95dfa9bb9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:13.538674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-45da373b-b716-46ee-9376-b6198834634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:13.618541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 763/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:13.627060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480b368-4147-440d-b273-ac03ba9a35fd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.639125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480b368-4147-440d-b273-ac03ba9a35fd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.642779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.643382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.643653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.643925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.652625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.654239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.663667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 742/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:13.711222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64647a54-7788-4d0d-8f00-7f91670551da None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.711888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64647a54-7788-4d0d-8f00-7f91670551da None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.711888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64647a54-7788-4d0d-8f00-7f91670551da None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.713122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 764/1506] 10.222.0.20 () {52 vars in 830 bytes} [Mon Aug 29 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:18:13.717667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:13.783873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3bddc-f567-4e6f-b123-cd09ab2a1d94 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:13.789144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:13.789789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.790066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.790335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] PATH_INFO: `/v3/users/9e1467a8bec94f359218b072e23af802` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.791488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1467a8bec94f359218b072e23af802)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:13.792543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:13.792543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:18:13.792543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:18:13.793862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:13.870982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1467a8bec94f359218b072e23af802'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:13.896501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1467a8bec94f359218b072e23af802'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:13.897364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1467a8bec94f359218b072e23af802'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:13.917333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1467a8bec94f359218b072e23af802'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:13.918676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1467a8bec94f359218b072e23af802'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:13.926127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.942261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 743/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:18:13 2022] DELETE /identity/v3/users/9e1467a8bec94f359218b072e23af802 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:13.947197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:13.947476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:13.947741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:13.968746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:13.969879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:13.980431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:14.041490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 765/1508] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:14.052682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.054995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:14.163937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc1dd-139f-4c7e-8b5f-5e99801ac6ac admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.169106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.169798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.170086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.170369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.181338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.182832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684561d7-202f-4aa4-a3dd-342e35910b2d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.195102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 744/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:14.588383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:14.590074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:14.603193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b142c-70bc-4f2f-8d41-1e0f49150878 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:14.609329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:14.610496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:14.610785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:14.611592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] PATH_INFO: `/v3/projects/2914f288bc4f4a09b6a19b10ea0fc474` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:14.612948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2914f288bc4f4a09b6a19b10ea0fc474)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:14.614065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:18:14.614065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:18:14.614065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:18:14.616000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:14.690580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2914f288bc4f4a09b6a19b10ea0fc474', 'request_id': 'req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:14.700503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2914f288bc4f4a09b6a19b10ea0fc474', 'request_id': 'req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:14.716197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2914f288bc4f4a09b6a19b10ea0fc474', 'request_id': 'req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:14.737880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] The token cache is being invalidate because project 2914f288bc4f4a09b6a19b10ea0fc474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:18:14.738170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:14.738936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-dcfc157f-7701-46aa-b5bd-5b9deaf40e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:18:14.740726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 766/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:18:14 2022] DELETE /identity/v3/projects/2914f288bc4f4a09b6a19b10ea0fc474 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:18:24.189857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:24.734378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:59.615312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:59.615949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:59.615949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:59.617305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:19:59.623491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acf18-bfc1-4152-af9a-e78788fd8119 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:59.624105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acf18-bfc1-4152-af9a-e78788fd8119 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:59.624105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acf18-bfc1-4152-af9a-e78788fd8119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:59.649648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-660acf18-bfc1-4152-af9a-e78788fd8119 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:59.650976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-660acf18-bfc1-4152-af9a-e78788fd8119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:59.762142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:19:59.922047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:59.923986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:00.068123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15fb3-8aa6-4223-aaa6-9e6b79e1f2dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:00.076320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:00.077005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:00.077283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:00.077550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:00.088317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:00.089966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f44b4-8205-4f32-88a2-e499c407281b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:00.101410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 746/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:01.010249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31193cf-9ddc-475b-a44d-7419b9ae12ee None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.010837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31193cf-9ddc-475b-a44d-7419b9ae12ee None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.010837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31193cf-9ddc-475b-a44d-7419b9ae12ee None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.012162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:01.017496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103afab-a2c8-47fd-a40b-5a96db2b22e2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.018073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103afab-a2c8-47fd-a40b-5a96db2b22e2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.018073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103afab-a2c8-47fd-a40b-5a96db2b22e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.041093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8103afab-a2c8-47fd-a40b-5a96db2b22e2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:01.042463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8103afab-a2c8-47fd-a40b-5a96db2b22e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:01.052131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:01.210249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31193cf-9ddc-475b-a44d-7419b9ae12ee None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:01.227649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31193cf-9ddc-475b-a44d-7419b9ae12ee None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:01.235189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:01.235861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.236174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.236588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.248042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:01.249971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1633f-0d25-44ea-91c0-188c06a9671e service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:01.263348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 769/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:03.355540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae60f3-fc9d-4ac6-9423-ab603f5de91c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:03.356109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae60f3-fc9d-4ac6-9423-ab603f5de91c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:03.356225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae60f3-fc9d-4ac6-9423-ab603f5de91c None None] PATH_INFO: `/v3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:03.357965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 748/1517] 10.222.0.71 () {54 vars in 925 bytes} [Mon Aug 29 20:20:03 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:03.369179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc62c-7b2e-4a12-8bd0-0f2d4184b0d4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:03.369881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc62c-7b2e-4a12-8bd0-0f2d4184b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:03.369881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc62c-7b2e-4a12-8bd0-0f2d4184b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:03.439930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-839cc62c-7b2e-4a12-8bd0-0f2d4184b0d4 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:03.441748 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-839cc62c-7b2e-4a12-8bd0-0f2d4184b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:03.539138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 770/1518] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Aug 29 20:20:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:11.035319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=49 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:12.662599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8add6-bf7e-4455-92e6-742b949d6329 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:12.663491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8add6-bf7e-4455-92e6-742b949d6329 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:12.663491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8add6-bf7e-4455-92e6-742b949d6329 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:12.665331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 749/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:12.672022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14b8-7374-49a6-81b0-36a6a37ec28b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:12.672709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14b8-7374-49a6-81b0-36a6a37ec28b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:12.672709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14b8-7374-49a6-81b0-36a6a37ec28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:12.694895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b24e14b8-7374-49a6-81b0-36a6a37ec28b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:12.696318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b24e14b8-7374-49a6-81b0-36a6a37ec28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:12.707857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 771/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:12.874014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8add6-bf7e-4455-92e6-742b949d6329 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:12.891478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8add6-bf7e-4455-92e6-742b949d6329 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:12.898130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:12.898933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:12.899078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:12.899393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:12.911441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:12.913396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baee30c-ea1a-4b45-b22c-aed953d59fc2 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:12.925814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 750/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:13.819715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc751-5b3f-45fe-8079-d9ace67d403c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:13.820609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc751-5b3f-45fe-8079-d9ace67d403c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:13.821420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc751-5b3f-45fe-8079-d9ace67d403c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:13.823743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:20:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:13.831440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb572-7526-4f0f-a114-e0bc8f0df575 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:13.832347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb572-7526-4f0f-a114-e0bc8f0df575 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:13.832347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb572-7526-4f0f-a114-e0bc8f0df575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:13.862281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8aecb572-7526-4f0f-a114-e0bc8f0df575 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:13.863583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8aecb572-7526-4f0f-a114-e0bc8f0df575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:13.876627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:14.056708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc751-5b3f-45fe-8079-d9ace67d403c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:14.077207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc751-5b3f-45fe-8079-d9ace67d403c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:14.083530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:14.084283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:14.084694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:14.085069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:14.096830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:14.098488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea226-ad21-4394-b50d-42fc55eea709 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:14.110551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 773/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:15.902771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52904f06-edbb-4db3-a7e9-48b5ff53248e None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:15.903664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52904f06-edbb-4db3-a7e9-48b5ff53248e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:15.903664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52904f06-edbb-4db3-a7e9-48b5ff53248e None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:15.905234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 752/1525] 10.222.0.20 () {54 vars in 961 bytes} [Mon Aug 29 20:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:15.911923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf096-274b-4529-9174-acf4a51edfa6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:15.912837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf096-274b-4529-9174-acf4a51edfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:15.912837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf096-274b-4529-9174-acf4a51edfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:15.934955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4edcf096-274b-4529-9174-acf4a51edfa6 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:15.936173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4edcf096-274b-4529-9174-acf4a51edfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:15.945573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 774/1526] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Aug 29 20:20:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:15.958875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52904f06-edbb-4db3-a7e9-48b5ff53248e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:15.982434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52904f06-edbb-4db3-a7e9-48b5ff53248e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:15.991270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:15.992287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:15.992778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:15.993208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:16.008333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:16.011166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a6843-507c-4a21-8f71-dbc1a8d012c9 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:16.029099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 753/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:25.642853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1d6f-c8cb-46a6-a649-882332ee6305 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:25.643643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1d6f-c8cb-46a6-a649-882332ee6305 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:25.643863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1d6f-c8cb-46a6-a649-882332ee6305 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:25.647212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:20:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:25.654503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32acd-3662-404a-a20f-abe491c49890 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:25.655410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32acd-3662-404a-a20f-abe491c49890 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:25.655410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32acd-3662-404a-a20f-abe491c49890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:25.681184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8cb32acd-3662-404a-a20f-abe491c49890 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:25.682582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8cb32acd-3662-404a-a20f-abe491c49890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:25.694220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:25.861862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1d6f-c8cb-46a6-a649-882332ee6305 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:25.871265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:25.884954 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1d6f-c8cb-46a6-a649-882332ee6305 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:25.891635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:25.892362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:25.892705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:25.893042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:25.903760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:25.905446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa563f1-b76d-48b3-9a23-55105ae54153 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:25.917703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 776/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:26.771582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4ef4-796e-40ea-bf94-b1099dffa62b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:26.772378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4ef4-796e-40ea-bf94-b1099dffa62b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:26.772378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4ef4-796e-40ea-bf94-b1099dffa62b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:26.773785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:20:26.779569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bbc-2414-4c31-a56f-82e3a09310c2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:26.780386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bbc-2414-4c31-a56f-82e3a09310c2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:26.780386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bbc-2414-4c31-a56f-82e3a09310c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:26.804761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-bcc36bbc-2414-4c31-a56f-82e3a09310c2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:26.807479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bcc36bbc-2414-4c31-a56f-82e3a09310c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:26.822600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:20:26.980207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4ef4-796e-40ea-bf94-b1099dffa62b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:26.996503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4ef4-796e-40ea-bf94-b1099dffa62b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:27.002917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:27.003460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:27.003739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:27.004011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:27.013929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:27.015559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa3a9e-d43d-45f5-a5a7-b48272d61252 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:27.029135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 756/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:31.194383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.194974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.194974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.196352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:31.202966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52fd2-2f9b-4edf-b637-57fef30b2b6d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.203491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52fd2-2f9b-4edf-b637-57fef30b2b6d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.203614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52fd2-2f9b-4edf-b637-57fef30b2b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.226269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-07c52fd2-2f9b-4edf-b637-57fef30b2b6d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:31.227506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-07c52fd2-2f9b-4edf-b637-57fef30b2b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:31.236704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:31.524732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:31.526692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:31.600479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7735db-b08d-43d4-b892-979483db7bd3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:31.605594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:31.606494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.606846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.607122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.620956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:31.625203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc9626-b275-4632-a1b5-e024621f7f09 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:31.635984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 779/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:33.717260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df03cbc-e569-49bf-88b8-db7312fc314b None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:33.717855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df03cbc-e569-49bf-88b8-db7312fc314b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:33.717855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df03cbc-e569-49bf-88b8-db7312fc314b None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:33.719170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:20:33.725904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91b49-7f04-4c33-8fe1-fcb6487e1d1f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:33.726573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91b49-7f04-4c33-8fe1-fcb6487e1d1f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:33.727567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f91b49-7f04-4c33-8fe1-fcb6487e1d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:33.751640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e1f91b49-7f04-4c33-8fe1-fcb6487e1d1f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:33.753948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e1f91b49-7f04-4c33-8fe1-fcb6487e1d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:33.764156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:34.101440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df03cbc-e569-49bf-88b8-db7312fc314b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:34.114869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df03cbc-e569-49bf-88b8-db7312fc314b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:34.119720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:34.122633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:34.122633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:34.122633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:34.133868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:34.135348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551854bd-d49f-464f-913b-9ac5117df756 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:34.147605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 759/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:38.130199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:38.130855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:38.130855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:38.132365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 781/1540] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:38.139343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e46a-8224-46d4-b0ec-096d9e564102 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:38.140007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e46a-8224-46d4-b0ec-096d9e564102 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:38.140007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e46a-8224-46d4-b0ec-096d9e564102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:38.168912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bb54e46a-8224-46d4-b0ec-096d9e564102 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:38.170209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb54e46a-8224-46d4-b0ec-096d9e564102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:38.181442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 760/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:38.903809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:38.906908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:38.993175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0218-ba2e-48cd-8fdc-97854d8053af None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:38.997267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:38.997903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:38.998176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:38.998442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:39.009359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:39.010966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e6b6-81be-4060-8c6f-bc8ffbc234e0 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:39.022581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 782/1542] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:41.327712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:41.328438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:41.328638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:41.331248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 761/1543] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:20:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:41.337962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa34-9b9b-4f0d-bc86-980f11fb3565 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:41.338935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa34-9b9b-4f0d-bc86-980f11fb3565 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:41.338935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fa34-9b9b-4f0d-bc86-980f11fb3565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:41.368767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a186fa34-9b9b-4f0d-bc86-980f11fb3565 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:41.370895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a186fa34-9b9b-4f0d-bc86-980f11fb3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:41.385685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 783/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:20:42.136643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:42.138644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:42.148101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=37 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:42.158836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6909-fbaa-4491-8f2a-5b117d8f29e9 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:42.166700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:42.167743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:42.168247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:42.168864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:42.186020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:42.188936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17c16f-a2c1-42d3-a9ed-a40532476285 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:42.208087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 762/1545] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:51.359882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=66 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:52.199692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:26.670231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:26.671564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:26.672125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:26.704161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:26.705987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:26.722017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 784/1546] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:26.733050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:26.733909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:26.733909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:26.769300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:26.771647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:26.785999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 763/1547] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:26.791468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:26.809113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b49d8-b246-4b5f-91a7-2cf9242e084b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:26.820481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:26.821543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:26.822035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:26.822515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:26.823402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:26.823917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:26.825858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:26.843141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 785/1548] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:26.852643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:26.871898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5427c-af58-44c8-9073-31c36b3c6e4d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:26.883607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:26.884296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:26.884630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:26.884915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:26.885609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:26.887725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:26.944116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 764/1549] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:26 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:26.950276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:26.967338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2eded-4ac7-4f24-9e55-b93017267f11 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.125338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.125990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.126591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.126717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.127303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.129687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46a1f1-25ee-4394-849e-35001949a09e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.170475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 786/1550] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:26 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:27.174546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:27.195426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc0b3-7a89-4339-bf79-f86602d7b4dc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.195841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc0b3-7a89-4339-bf79-f86602d7b4dc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.196314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bc0b3-7a89-4339-bf79-f86602d7b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.199261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f736-8194-41a5-b175-25195060c1df admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.210627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.211705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.212177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.212686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.213570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.215694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.236186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 765/1551] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:27.240443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:27.251143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-022bc0b3-7a89-4339-bf79-f86602d7b4dc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.255707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-022bc0b3-7a89-4339-bf79-f86602d7b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.258902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187076-1369-4e65-8dc6-b6db498754ec admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.268790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.269785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.270260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.270859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.271874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.275033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.282244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 787/1552] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.289564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001f3b-5832-4959-9579-e799ced87679 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.289997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001f3b-5832-4959-9579-e799ced87679 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.290458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88001f3b-5832-4959-9579-e799ced87679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.320814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 766/1553] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:27.328941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:27.385517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8247d5-a30c-4bd5-ad93-2bb532c7fd58 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.388557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-88001f3b-5832-4959-9579-e799ced87679 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.401540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-88001f3b-5832-4959-9579-e799ced87679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.413784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.414990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.415465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.415915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] PATH_INFO: `/v3/projects/7fcf5b6d03c04c41a795589323962e78/users/45c041b057d14b00b494d275bbdb079d/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.441916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 788/1554] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:27.444357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5795b-1093-48a7-8a57-badb7bae2264 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.444885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5795b-1093-48a7-8a57-badb7bae2264 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.445342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5795b-1093-48a7-8a57-badb7bae2264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.472034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcf5b6d03c04c41a795589323962e78, user_id=45c041b057d14b00b494d275bbdb079d, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.486455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.500063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-75e5795b-1093-48a7-8a57-badb7bae2264 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.504090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-75e5795b-1093-48a7-8a57-badb7bae2264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.512743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 767/1555] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:27 2022] PUT /identity/v3/projects/7fcf5b6d03c04c41a795589323962e78/users/45c041b057d14b00b494d275bbdb079d/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:27.517703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:27.637782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7a5a2-b03c-4ec8-8560-7a5715811813 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.656258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.657895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.658383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.658987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.664806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:27.665592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.667749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:27.667749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:22:27.667749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:22:27.669438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34826b-7f5d-4d7a-b65e-de8ea627f60b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.705125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 768/1556] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:27.708517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666db32-3283-43c8-97f2-2c3d7e42d844 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.709077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666db32-3283-43c8-97f2-2c3d7e42d844 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.709526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666db32-3283-43c8-97f2-2c3d7e42d844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.718733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 789/1557] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.721517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.721846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.722178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.756210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d666db32-3283-43c8-97f2-2c3d7e42d844 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.758084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d666db32-3283-43c8-97f2-2c3d7e42d844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.759832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.761949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.773834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 769/1558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.775674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffc69-7ec1-4f01-82e5-8f8f05fe9e77 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.775853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 790/1559] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.776386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffc69-7ec1-4f01-82e5-8f8f05fe9e77 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.776706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:27.777330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ffc69-7ec1-4f01-82e5-8f8f05fe9e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.803643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f413f-d3ab-4aaa-b43b-c1095a84ae92 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:27.810281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b11ffc69-7ec1-4f01-82e5-8f8f05fe9e77 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.811082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:27.811530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b11ffc69-7ec1-4f01-82e5-8f8f05fe9e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.812017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.812502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.812925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.814019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:27.815533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:27.815533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:22:27.815533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:22:27.817088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16590c-63c1-42ac-a6d0-da9a59de1c96 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:27.821182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 770/1560] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.822395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623085-99f2-4706-a96b-aef5a16bdb84 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.822743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623085-99f2-4706-a96b-aef5a16bdb84 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.823076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14623085-99f2-4706-a96b-aef5a16bdb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.847631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-14623085-99f2-4706-a96b-aef5a16bdb84 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.848989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-14623085-99f2-4706-a96b-aef5a16bdb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.858629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 771/1561] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.859979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.859979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.860578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.889095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 791/1562] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:27.891591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d904-ccc0-48f3-99d2-a9b0d0fc5be3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:27.891591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d904-ccc0-48f3-99d2-a9b0d0fc5be3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:27.891958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521d904-ccc0-48f3-99d2-a9b0d0fc5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:27.895249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.895249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.915544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5521d904-ccc0-48f3-99d2-a9b0d0fc5be3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:27.916876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5521d904-ccc0-48f3-99d2-a9b0d0fc5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:27.947597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:27.964176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:27.979904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 772/1563] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:27.980945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.020996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 792/1564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.023473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e015-9f8f-4980-a3f3-28e4b6eb49a2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.023957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e015-9f8f-4980-a3f3-28e4b6eb49a2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.024674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e015-9f8f-4980-a3f3-28e4b6eb49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.055626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3ea2e015-9f8f-4980-a3f3-28e4b6eb49a2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.057327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3ea2e015-9f8f-4980-a3f3-28e4b6eb49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.066347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 793/1565] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.067550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.067847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.068121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.073690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e65259-bb22-450c-9550-bcb7e81e5b61 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.079295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.079998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.080333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.080724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.093603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.095535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.095750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.098279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1cbf0-380e-434c-8125-39634e1f214d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.106277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 794/1566] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.110516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.116650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 773/1567] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:28.118210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.118577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.118743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.122633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2534b-5eef-4209-b4b8-d0167dcb81d7 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.130832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.131736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.132142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.132803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.133765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.134192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.136094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412ea71-5935-4f2b-9a93-007bf6fe9671 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.142515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.143803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.153021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 774/1568] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.153331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 795/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.161972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.164927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aff68-3f61-4414-8c7e-e6320d80526b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.165484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aff68-3f61-4414-8c7e-e6320d80526b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.166090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aff68-3f61-4414-8c7e-e6320d80526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.173975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fc7c2-db10-4cea-bc0f-2e338ed90370 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.180611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.180611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.181041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.181041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.181703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.182875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:28.182875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:22:28.182875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:22:28.183984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.195758 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4d5aff68-3f61-4414-8c7e-e6320d80526b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.197821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4d5aff68-3f61-4414-8c7e-e6320d80526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.211495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 796/1570] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.213587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bf1d-4ef1-4ee6-a49b-14c4294c23f1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.214139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bf1d-4ef1-4ee6-a49b-14c4294c23f1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.214557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bf1d-4ef1-4ee6-a49b-14c4294c23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.215102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 775/1571] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.215788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.228557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b00de-9be3-4e10-8fca-f84f0c5f0e43 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.234617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.235336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.235976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.236403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.237122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.237436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.239101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.246038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-86a9bf1d-4ef1-4ee6-a49b-14c4294c23f1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.247836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-86a9bf1d-4ef1-4ee6-a49b-14c4294c23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.256015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 776/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.260737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.269713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e96b3-e688-414e-989e-42329e18f3ce admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.270486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 797/1573] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.273927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.273927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.273927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.279995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.281095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.281638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.281952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.282690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.283007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.286277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.308975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 777/1574] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.310357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.317627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.323597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.333823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938189d-d013-4f48-8468-5d674f2b1946 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.339467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 798/1575] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.340509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.341613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.341763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.341933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.342210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.342856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.345964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.358573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457a019-a572-44f5-9c55-b268271b3175 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.366146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.367130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.367581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.368197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.368832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.369309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.373824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.389579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 778/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.389579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.400450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 799/1577] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.400450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.418023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e32e-f0be-40bb-86ed-3e79a0a115a9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.510614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.511126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.511404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.511673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.512539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.514546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.542286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf21112-6278-4772-9a52-dc03645b789b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.549073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.549902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.550082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.550511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.551335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.553305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.555777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 800/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.561062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.577199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 779/1579] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:28.578587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.609816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d879cb8-a368-4fc6-9243-c44ef8caa0c2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.664487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:28.717504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.718463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.718974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.720740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.724461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.731274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.733002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:28.742649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad046240-f95c-4c8e-b13b-c12cd153333f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.760329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.764697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.765783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.767788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.769600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.770361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.776239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.798853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 780/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.801532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.820483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 801/1581] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.821542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.838262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64232c46-f5d0-4210-9185-ddcc7a4fc0bb admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.892797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b269-b874-4052-9635-6cbb417bb0c0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.899019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.899811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.899976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.900292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.901342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:28.901487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.903074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.925855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 781/1582] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:28.925855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.933265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.934311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.934795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.935284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.936462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.941162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.944622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22a61-f9b5-4424-b8fb-f17f56ba238b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.951522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.952607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.953343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.954466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.955317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.957441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.990744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 802/1583] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.992246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.997884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 782/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/users => generated 279 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:28.997884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.016139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a943-c06e-424e-99d3-4bc8bf93a7b7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.104525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58e25-c587-4b28-9c28-452cb8168fb7 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.111989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.112778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.113115 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.113454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.114586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.116846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.139457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.140455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.140675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.140873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.141692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.147806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.154236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 803/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.156384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.176092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110340d-4d18-4a11-ad90-774bfd2aed80 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.181416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 783/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.181416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.186545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.188022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.188692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.189288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.190829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.194483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.201463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809141c-aa7a-4713-9494-55de816235a4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.213294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.214343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.214802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.215289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.216481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.223173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.232659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 804/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/users => generated 289 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.234430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.250888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647773-17a6-48ab-a488-73452c915297 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.259320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.261255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.261878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.262394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.263355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.265852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.285982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 784/1588] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.287449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.297636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:29.331377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 805/1589] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.333404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.410662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:29.463893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664ac44-ab98-4b61-bda0-1e064352cd45 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.482055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922b3dd-bb43-42c7-9080-bc8d26a637f9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.489445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.490582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.490958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.491331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.492373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.494492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.510559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 806/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.511679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.523908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9772a1-7628-49d9-abf6-109db5d8718a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.529663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.530479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.531289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.531289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.532312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.534463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.546749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 807/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.548327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.560926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614c3c-3ac6-40a1-ac5f-307958c54acd admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.566628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.567522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.567915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.568430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] PATH_INFO: `/v3/projects/0ddf6aeb067f4b3182f5684947196e98/users/bfacd0a28d2a4dcb90eff48a42f0ffc7/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.574262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.575790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.576248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.576697 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.578491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.581662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.589087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddf6aeb067f4b3182f5684947196e98, user_id=bfacd0a28d2a4dcb90eff48a42f0ffc7, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.590348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:29.590348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:22:29.590348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:22:29.592983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.617061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 808/1592] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:29 2022] PUT /identity/v3/projects/0ddf6aeb067f4b3182f5684947196e98/users/bfacd0a28d2a4dcb90eff48a42f0ffc7/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:29.618962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.621559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 785/1593] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/users => generated 286 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.623217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.638740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc012dcf-bb0d-4dd6-8a0d-2ff4ac22a243 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.720577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10acc2d-2f44-4f3b-a294-84cd1d10942c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.728042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.729032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.729457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.730081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.731907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.734406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.752208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.753264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.753700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.754190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.755029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.758079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.758296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 809/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.759790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.782496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4a52-256a-47ca-ae8c-cf1e49b5bbc1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.794563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.795332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 786/1595] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.795830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.796251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.796370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.797198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.800109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.806247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.811077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299b8e5-f195-4586-b040-6bf664210c52 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.818809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.819915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.819915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.820254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.821016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.822953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.840056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 787/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.841324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.863001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e86b-6bce-4aee-a9f4-f5eb15cf0a14 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.866628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 810/1597] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:29.867716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.874051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.876498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.878814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.879781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.881868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.884088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee7554-010c-4bdd-9abc-74975c8f78e0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.887395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e65b-80c8-4f93-bb24-9675a7f5c792 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.894832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.895775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.896132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.896494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.897979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.899456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.928893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 788/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.928893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341457-88ba-4733-8630-501441daa96d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.928893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341457-88ba-4733-8630-501441daa96d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.928893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80341457-88ba-4733-8630-501441daa96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.931816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 811/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.932955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.952044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237572c7-2dc5-439b-99a5-5554a5e3264c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.959466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.960249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.960815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.961096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:29.961258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.962901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.965478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.972943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-80341457-88ba-4733-8630-501441daa96d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:29.976648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-80341457-88ba-4733-8630-501441daa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:29.982010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 812/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:29.987828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.995892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 789/1601] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:29.999876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80341457-88ba-4733-8630-501441daa96d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.009976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0da36-ea08-4fc2-9f20-3e4012c3294e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.018221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.019251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.019879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.020244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.021196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.023294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.024584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80341457-88ba-4733-8630-501441daa96d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.038289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.040316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.040751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.041168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] PATH_INFO: `/v3/projects/7542c2dc6f13404999692f82c38bdfd9/users/a89623c2adae4bd2adc9e1d6ac29d7bd/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.041955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 813/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:30.043391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.072181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7542c2dc6f13404999692f82c38bdfd9, user_id=a89623c2adae4bd2adc9e1d6ac29d7bd, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.076558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6dfac-9e77-4d1b-9a8e-7a1f2a981e16 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.076952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.086682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.088013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.088553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.089012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.090276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.093513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.112528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 790/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:29 2022] PUT /identity/v3/projects/7542c2dc6f13404999692f82c38bdfd9/users/a89623c2adae4bd2adc9e1d6ac29d7bd/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:30.112528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.123252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 814/1604] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:30.124365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.143882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeac0f-22ee-44dc-a5be-38a3d67ee41d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.187789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:30.207746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f1b3-a244-4ca1-803e-163f6bedea30 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.213436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.214571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.214870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.215151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] PATH_INFO: `/v3/projects/6f97e78e27884836a75f450ec3cbd567/users/731441c71fdd46d28cf6d83c511226c9/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.246973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f97e78e27884836a75f450ec3cbd567, user_id=731441c71fdd46d28cf6d83c511226c9, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.253459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.281682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 791/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:30 2022] PUT /identity/v3/projects/6f97e78e27884836a75f450ec3cbd567/users/731441c71fdd46d28cf6d83c511226c9/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:30.284250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.308346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.309423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.310678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.311031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.312295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.316961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.339647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 815/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:30.340651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.342990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.441942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37881f21-7f94-41a0-9bcc-3ae189db1341 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.447662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.448757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.449142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.449523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] PATH_INFO: `/v3/projects/a34cad2b6a8742cbae2a54b0826e69af/users/7e552e85d3ba484baf73a5b9dc88764c/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.467398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526261a-4609-4613-8041-7e7ec73039d5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.478181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34cad2b6a8742cbae2a54b0826e69af, user_id=7e552e85d3ba484baf73a5b9dc88764c, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.487338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.515335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 792/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:30 2022] PUT /identity/v3/projects/a34cad2b6a8742cbae2a54b0826e69af/users/7e552e85d3ba484baf73a5b9dc88764c/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:30.516695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.590275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.591168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.591784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.591971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.672714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.672714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57bc8-9293-4cd3-bfef-e88c081f3ec7 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.673288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:30.673520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 816/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:30.673520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.673520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.673520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.680784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68e5be-2f8c-4935-aac1-5ed62d400cde admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.713337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.714810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.717832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.722639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.728317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.733704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.773618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] MFA Rules not processed for user `a89623c2adae4bd2adc9e1d6ac29d7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:30.776152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.779901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 793/1609] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:30.783347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.834716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7dc00-e597-43f1-8e21-0f56dd7f0974 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.846932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.848040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.848604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.849172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.850557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.853926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10b56-37b1-4e19-8541-3413b339a3b6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.913461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 794/1610] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:30.920308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.922937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.923451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.993009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 817/1611] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:30.995333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.010215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.019846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1fe6b-0820-4e54-bd17-4d3d6b1ae884 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.023290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] MFA Rules not processed for user `731441c71fdd46d28cf6d83c511226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:31.026394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.030988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.032455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.033236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.034519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] PATH_INFO: `/v3/projects/4db9d633157e4379a6488cb03ec6a945/users/0b85b46db20841388e91434daaec5a9d/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.068254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db9d633157e4379a6488cb03ec6a945, user_id=0b85b46db20841388e91434daaec5a9d, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.071845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084467c-ca60-4222-a7ca-295a4505b76e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.096260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 818/1612] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:30 2022] PUT /identity/v3/projects/4db9d633157e4379a6488cb03ec6a945/users/0b85b46db20841388e91434daaec5a9d/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:31.098442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.098442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.098692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.135993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:31.138865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.148319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 795/1613] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:31.149133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.171115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca1b5c-b791-4e72-8a69-7121812994c1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.292916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.294285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.294753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.295065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] PATH_INFO: `/v3/projects/ecbaac88c6734c1ba87a43b94438d091/users/785ae16fec4d47808cb34a18af006b00/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.317287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbaac88c6734c1ba87a43b94438d091, user_id=785ae16fec4d47808cb34a18af006b00, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.320954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.356526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 819/1614] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:31.356526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.356962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 796/1615] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:31 2022] PUT /identity/v3/projects/ecbaac88c6734c1ba87a43b94438d091/users/785ae16fec4d47808cb34a18af006b00/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:31.356962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.371976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cade4-3d27-42da-9b19-d5afbed0cad5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.411827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.445085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605e08-bd5e-488e-91de-6e5b11a3d987 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.457378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.458349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.458893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.459331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.460632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.464693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.465017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.465664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.466097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.466644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] PATH_INFO: `/v3/projects/9339228b6135425eb93c8982dcdefeaf/users/d2e42382876f4d9caf93c645099719cd/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.495884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9339228b6135425eb93c8982dcdefeaf, user_id=d2e42382876f4d9caf93c645099719cd, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.499757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f963-8236-4b6a-b9a0-ce2dc40d1a86 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.522671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 820/1616] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:31 2022] PUT /identity/v3/projects/9339228b6135425eb93c8982dcdefeaf/users/d2e42382876f4d9caf93c645099719cd/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:31.524691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.525229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.525724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.530857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 797/1617] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/projects => generated 357 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:31.530857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.578164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] MFA Rules not processed for user `0b85b46db20841388e91434daaec5a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:31.581067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.634580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155eb1-5486-4d30-ac69-ed6c3786dbf2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.639398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.640067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.640328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.640640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.642134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.644362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b890e50-8037-4797-99bc-81eb9132ce23 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.676100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.685468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 798/1618] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:31.685468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.685468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.685468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.700957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 821/1619] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:31.704204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.723041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] MFA Rules not processed for user `785ae16fec4d47808cb34a18af006b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:31.724734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.810474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2b5dc-7d6f-45ac-846c-91e134cf3ebc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.844067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 799/1620] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:31.846075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.892895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.893833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.894123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.894448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.907817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.938288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedfa88-338f-42f6-bffe-71a7e2aeb8ab None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.943993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.944877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.945277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.945647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.946467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.948601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.981846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.983635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d121-7b5a-493c-bbcc-4264151735e8 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.999106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 822/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:32.000806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.001199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.001783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.005851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 800/1622] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:32.006961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.027511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456b58-a251-4066-a9b4-bdcd53828ed5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.050718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.051306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.051584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.051861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.052629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.054691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40312d20-d684-401c-a171-c2570901e56c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.111732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] MFA Rules not processed for user `d2e42382876f4d9caf93c645099719cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:32.116423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:32.121243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 801/1623] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:32 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:32.121243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6412-c660-4948-9cfe-03ab15c31f33 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.121243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6412-c660-4948-9cfe-03ab15c31f33 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.121796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6412-c660-4948-9cfe-03ab15c31f33 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.124199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 802/1624] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 29 20:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:32.131034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6412-c660-4948-9cfe-03ab15c31f33 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.194879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6412-c660-4948-9cfe-03ab15c31f33 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.213997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.228247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.232023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.232387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:32.235069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.238483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.246097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fdcc-b868-4688-8673-41311292f892 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.264688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 823/1625] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:32.267345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.281305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b23a-ba39-4fa2-9894-5c3c613941e1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.295177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.295177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.295177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.295177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.295985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.300788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.349289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 824/1626] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:32.349289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.359770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 803/1627] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:32 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:32.364210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.366998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.367908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.373403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a2f7-60ae-41d5-9ef3-e10dbac69982 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.484201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:32.487903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:32.551251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.552226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.552887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.553582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.555252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.558334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.581797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 825/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:32.584727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.621712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 804/1629] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Aug 29 20:22:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:32.623020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.648578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91403-5c2d-46ad-8f2a-610c08f98988 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.660825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.661524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.661801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.662076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] PATH_INFO: `/v3/projects/3df3593f955244a3a928a652e5d565a6/users/20c401e8ce504cd0a3c6c308f9170875/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.709672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df3593f955244a3a928a652e5d565a6, user_id=20c401e8ce504cd0a3c6c308f9170875, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.715382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.742294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 805/1630] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:32 2022] PUT /identity/v3/projects/3df3593f955244a3a928a652e5d565a6/users/20c401e8ce504cd0a3c6c308f9170875/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:32.743261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.757048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4740bd-b2bc-42d5-b627-b038f602ab3f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.881262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:32.921549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.922467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.922638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.923022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.949878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548e677-365f-42be-8164-4e8b4b2002b8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.966755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.968470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.968995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.969308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.972915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.983730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.047831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 806/1631] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:32 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:33.048800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.070468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:33.084457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32c26-c10e-430d-8248-f6f3973aa837 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.098877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.100054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.100574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.100976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] PATH_INFO: `/v3/projects/9f363ea9a5864521be40a8d4742f19c8/users/53ce1b71e3c84503939d4b03fa72b307/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.104212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.106144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.160832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 826/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:33.161706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.178640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f363ea9a5864521be40a8d4742f19c8, user_id=53ce1b71e3c84503939d4b03fa72b307, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.188642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.241991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 807/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:33 2022] PUT /identity/v3/projects/9f363ea9a5864521be40a8d4742f19c8/users/53ce1b71e3c84503939d4b03fa72b307/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:33.244095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.454535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac748-ebd6-4a94-9808-b4180855b3ba service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.481136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa1ea-b268-4b34-9ce8-83b37c80dac8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.502210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.503911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.504747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.505455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.506820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.509929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.554342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 808/1634] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:33.559380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.603511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2870-b372-41ed-a154-964962602ee0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.629511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.631135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.631973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.632743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.634255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.637623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.644999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.645644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.645908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.646175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.680010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 809/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:33.682044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.728124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7f086-1236-4030-8846-df2d6ef88510 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.759036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.760249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.760917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.761480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.762688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.765707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.806465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.809436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.836618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 827/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:33.837941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 810/1637] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:33.839148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.843392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.867076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2912f18-cab8-48ff-a9e3-9afcee204f94 service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.879520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.880640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.881095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.881506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] PATH_INFO: `/v3/projects/3df3593f955244a3a928a652e5d565a6/users/20c401e8ce504cd0a3c6c308f9170875/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.887258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df3593f955244a3a928a652e5d565a6, user_id=20c401e8ce504cd0a3c6c308f9170875, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.888385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833783d-1c3b-42c0-b799-42ec95034da6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.892733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.910104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.912054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.912587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.913065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] PATH_INFO: `/v3/projects/be9b08b385384b4380a3e52d14529443/users/b1f3bdd9142b498fafc7fe3f3e37343f/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.938777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 828/1638] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:33 2022] PUT /identity/v3/projects/3df3593f955244a3a928a652e5d565a6/users/20c401e8ce504cd0a3c6c308f9170875/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:33.940697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.960288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9b08b385384b4380a3e52d14529443, user_id=b1f3bdd9142b498fafc7fe3f3e37343f, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.965142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818ffd-adaa-4c20-bbf1-bbba54a7e884 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.970735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.029009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 811/1639] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:33 2022] PUT /identity/v3/projects/be9b08b385384b4380a3e52d14529443/users/b1f3bdd9142b498fafc7fe3f3e37343f/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:34.032728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76e48-a75d-48f2-a76d-277c90048d4e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.035273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76e48-a75d-48f2-a76d-277c90048d4e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.035273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d76e48-a75d-48f2-a76d-277c90048d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.097926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94bcc-8780-4946-ac77-c9d4ecfeaac0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.153931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-55d76e48-a75d-48f2-a76d-277c90048d4e None None] MFA Rules not processed for user `20c401e8ce504cd0a3c6c308f9170875`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.168188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-55d76e48-a75d-48f2-a76d-277c90048d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.337980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.338725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.338991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.339356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] PATH_INFO: `/v3/projects/9f363ea9a5864521be40a8d4742f19c8/users/53ce1b71e3c84503939d4b03fa72b307/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.347395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.350028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f363ea9a5864521be40a8d4742f19c8, user_id=53ce1b71e3c84503939d4b03fa72b307, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.358911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.421368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 829/1640] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:33 2022] PUT /identity/v3/projects/9f363ea9a5864521be40a8d4742f19c8/users/53ce1b71e3c84503939d4b03fa72b307/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:34.426568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.456902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 812/1641] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:34.458392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386c0d-ad48-4ef9-aad8-a98c520ed1f3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.460530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386c0d-ad48-4ef9-aad8-a98c520ed1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.460530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386c0d-ad48-4ef9-aad8-a98c520ed1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.550889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-82386c0d-ad48-4ef9-aad8-a98c520ed1f3 None None] MFA Rules not processed for user `53ce1b71e3c84503939d4b03fa72b307`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.552222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-82386c0d-ad48-4ef9-aad8-a98c520ed1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.633546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b096b1f-e813-4b46-aacf-03d715fe3130 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.693602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.696548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.697098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.699878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.703049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.713365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.754316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 830/1642] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:34.755305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.838236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 813/1643] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:34.840173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f60d1-4c10-49dd-b418-a2c2ffa900ba None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.841313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f60d1-4c10-49dd-b418-a2c2ffa900ba None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.841595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f60d1-4c10-49dd-b418-a2c2ffa900ba None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.847169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 814/1644] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 29 20:22:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:34.848765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f60d1-4c10-49dd-b418-a2c2ffa900ba None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.891751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f60d1-4c10-49dd-b418-a2c2ffa900ba None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.896554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.898957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.899906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.900646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.901005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] PATH_INFO: `/v3/projects/be9b08b385384b4380a3e52d14529443/users/b1f3bdd9142b498fafc7fe3f3e37343f/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.908418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9b08b385384b4380a3e52d14529443, user_id=b1f3bdd9142b498fafc7fe3f3e37343f, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.911685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffa41f-f47f-403a-83e8-2c4eacf53829 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.923231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d7c8c-eb61-45d5-a56c-22f9167166e2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.928575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.930668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.932078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.932860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.940129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 815/1645] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:34 2022] PUT /identity/v3/projects/be9b08b385384b4380a3e52d14529443/users/b1f3bdd9142b498fafc7fe3f3e37343f/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:34.947828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6171-1411-4fc6-afd9-09111b52538a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.948452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6171-1411-4fc6-afd9-09111b52538a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.948452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd6171-1411-4fc6-afd9-09111b52538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.006728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3ddd6171-1411-4fc6-afd9-09111b52538a None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:35.012098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3ddd6171-1411-4fc6-afd9-09111b52538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.105993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.109137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.137082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 831/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:35.139693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.158514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd30f0-b01d-4bca-9704-2c026e407d02 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.239563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 816/1647] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:35.239563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.239563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.239563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.349159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] MFA Rules not processed for user `b1f3bdd9142b498fafc7fe3f3e37343f`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:35.351749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.354074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.354848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.355224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.355746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.460887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:35.515113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.517935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.536334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 832/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:35.537389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.555765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909ced-bc3f-44c8-ac9c-5792b9883554 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.568839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 817/1649] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:35.576081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.577669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.578088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.583705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.617646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.620649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.636069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 833/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:35.727076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.754983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c79da1-99d0-4823-8a2e-6e7add07cb66 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.760584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.761609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.762034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.762457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.780281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.782564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.810702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 818/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:35.936907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.959617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff848-c0e8-4995-b49f-334d7ec617cc service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.968275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.970389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.971014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.971459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.084358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:36.174974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.180144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba84be-8037-4f1e-b779-af48393d88a2 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.233096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 834/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:37.279808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:37.476419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14b73-794a-4ce0-809b-a7bbc7738092 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.493382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.493679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.493975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.496928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] PATH_INFO: `/v3/users/731441c71fdd46d28cf6d83c511226c9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.501086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=731441c71fdd46d28cf6d83c511226c9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.508772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.727140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731441c71fdd46d28cf6d83c511226c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:37.791205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3979e-3528-401d-97f6-fc891f6ebaca None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.792004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3979e-3528-401d-97f6-fc891f6ebaca None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.792154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3979e-3528-401d-97f6-fc891f6ebaca None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.795193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 835/1653] 10.222.0.20 () {54 vars in 962 bytes} [Mon Aug 29 20:22:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:37.814635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c77bf-b5f5-46b2-8153-f1d440117c6b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.817845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c77bf-b5f5-46b2-8153-f1d440117c6b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.818671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c77bf-b5f5-46b2-8153-f1d440117c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.836789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731441c71fdd46d28cf6d83c511226c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:37.842608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731441c71fdd46d28cf6d83c511226c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:37.904305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731441c71fdd46d28cf6d83c511226c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:37.907226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-71f3f268-3c22-43db-9155-b01e82c2aa7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731441c71fdd46d28cf6d83c511226c9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:37.914141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5a4c77bf-b5f5-46b2-8153-f1d440117c6b None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:37.916424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5a4c77bf-b5f5-46b2-8153-f1d440117c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:37.947023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 836/1654] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Aug 29 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:37.959001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecb6b-b327-40c6-8239-88d9fdccef18 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.960197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecb6b-b327-40c6-8239-88d9fdccef18 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.960720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcecb6b-b327-40c6-8239-88d9fdccef18 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.963479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 837/1655] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 29 20:22:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:37.971104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.971831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.972437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.991797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 819/1656] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:37 2022] DELETE /identity/v3/users/731441c71fdd46d28cf6d83c511226c9 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:37.999346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:38.003619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:38.005730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:38.029783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:38.031160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:38.086382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:38.093747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:38.209449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 838/1657] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:38.210646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:38.214291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:38.218208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:38.302379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 820/1658] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:38.303747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:38.305297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:38.388138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad3df-f66e-4e04-bd74-27c7e8324175 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:38.405908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1f3bdd9142b498fafc7fe3f3e37343f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b08b385384b4380a3e52d14529443', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:38.406693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:38.406904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:38.407190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:38.408105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:38.408606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:38.410607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:38.459160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 839/1659] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:38.460354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:38.464363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:38.467132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53ab8-2b8c-467c-a647-ba7232e05ca5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:38.471977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:38.472766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:38.473145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:38.473524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:38.499411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:38.501813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:38.529071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 821/1660] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:38.540530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:38.567331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7dd5-0965-4e3f-9ae6-623ed7b260da service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:38.584328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1f3bdd9142b498fafc7fe3f3e37343f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b08b385384b4380a3e52d14529443', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:38.585422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:38.585859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:38.586293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:38.587238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:38.589594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:38.636768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:38.662449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30885-4d60-484b-89eb-c3c7854a8c15 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:38.685013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:38.686078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:38.686836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:38.687322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:38.723624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:38.725716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:38.749066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 822/1661] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:38 2022] POST /identity/v3/projects => generated 353 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:38.750917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 840/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:38.751436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:39.031737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d7f7c-04ee-4624-a891-3b45aa2fd4b1 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:39.048981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1f3bdd9142b498fafc7fe3f3e37343f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b08b385384b4380a3e52d14529443', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:39.049633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:39.049922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:39.050199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:39.050875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:39.051182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:39.052876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b7e0d-f22b-4364-8fa1-ea5b109f741a tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:39.090809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 823/1663] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:39.247276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:39.270290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927cff9-2231-4433-be6a-0c0c7b63fc37 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:39.303790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1f3bdd9142b498fafc7fe3f3e37343f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9b08b385384b4380a3e52d14529443', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:39.304502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:39.304877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:39.305179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] PATH_INFO: `/v3/projects/808d82435c8046fb9e7e9e30df5e5070` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:39.307691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorizing `identity:delete_project(project_id=808d82435c8046fb9e7e9e30df5e5070)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:39.309884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:39.396447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:39.397067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:39.397296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:39.484565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808d82435c8046fb9e7e9e30df5e5070', 'request_id': 'req-b32fecdc-9308-4937-9621-58f2525ff590'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:39.496175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] MFA Rules not processed for user `45c041b057d14b00b494d275bbdb079d`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:39.498741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808d82435c8046fb9e7e9e30df5e5070', 'request_id': 'req-b32fecdc-9308-4937-9621-58f2525ff590'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:39.498930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:39.521096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808d82435c8046fb9e7e9e30df5e5070', 'request_id': 'req-b32fecdc-9308-4937-9621-58f2525ff590'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:39.546931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] The token cache is being invalidate because project 808d82435c8046fb9e7e9e30df5e5070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:39.547603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:39.555467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b32fecdc-9308-4937-9621-58f2525ff590 tempest-VolumeQuotaClassesTest-1695662390 tempest-VolumeQuotaClassesTest-1695662390-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:39.558409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 841/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:39 2022] DELETE /identity/v3/projects/808d82435c8046fb9e7e9e30df5e5070 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:39.655962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:39.719273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 824/1665] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:39.731943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:39.732482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:39.732770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:39.793795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] MFA Rules not processed for user `45c041b057d14b00b494d275bbdb079d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:39.795188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:39.825745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 842/1666] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:39.842897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:39.845150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:40.107310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:40.109592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:40.158013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5c22-6b4d-4e5b-b868-929b32b05e70 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:40.191555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:40.192197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:40.193551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:40.194474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:40.228374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:40.243373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:40.290490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 825/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:40.308711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ec8e3-461c-4ef0-bb46-a4b434baa4d5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:40.322079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:40.323130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:40.327689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:40.328987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] PATH_INFO: `/v3/users/0b85b46db20841388e91434daaec5a9d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:40.332713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b85b46db20841388e91434daaec5a9d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:40.336163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: WARNING py.warnings [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:40.336163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: warnings.warn(msg) Aug 29 20:22:40.336163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: Aug 29 20:22:40.340120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:40.355224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:40.357087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:40.403602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ac93-dfa2-443e-a646-82f206c6e0fb service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:40.437851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:40.438603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:40.438993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:40.439531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] PATH_INFO: `/v3/users/785ae16fec4d47808cb34a18af006b00` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:40.441114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=785ae16fec4d47808cb34a18af006b00)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:40.443093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:40.564806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785ae16fec4d47808cb34a18af006b00'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.592404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b85b46db20841388e91434daaec5a9d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.594709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785ae16fec4d47808cb34a18af006b00'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.604939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785ae16fec4d47808cb34a18af006b00'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.615565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785ae16fec4d47808cb34a18af006b00'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.616603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-77f28e42-90d6-4940-ba08-5911de05e8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785ae16fec4d47808cb34a18af006b00'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.663179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b85b46db20841388e91434daaec5a9d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.667645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 826/1668] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:40 2022] DELETE /identity/v3/users/785ae16fec4d47808cb34a18af006b00 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:40.672198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:40.672612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:40.672872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:40.716916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b85b46db20841388e91434daaec5a9d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.720194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b85b46db20841388e91434daaec5a9d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.731076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:40.732304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:40.749061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:40.786321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7e2c061b-614b-47bd-a7d8-422b66696d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b85b46db20841388e91434daaec5a9d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:40.812025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 843/1669] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:40 2022] DELETE /identity/v3/users/0b85b46db20841388e91434daaec5a9d => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:40.817889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:40.821267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:40.828965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:40.884995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:40.886236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:40.888421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:40.956177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 827/1670] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:41.014593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:41.017658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:41.129645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 844/1671] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:41.208556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df20de-df68-4dd8-95b7-a8c9098867b4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:41.222588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:41.442601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:41.443255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:41.443508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:41.443776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:41.499841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:41.502554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:41.518321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67d053-1e38-45b0-94ad-ad3b7ae7cca2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:41.532917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:41.535293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:41.535742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:41.536627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:41.555015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 828/1672] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:41.556191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:41.570992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:41.578692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:41.582537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:41.619647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 845/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:41.629955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae369-24e0-4907-bda0-b421565e27dc service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:41.649430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:41.650460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:41.650946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:41.651420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] PATH_INFO: `/v3/projects/6f97e78e27884836a75f450ec3cbd567` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:41.656140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f97e78e27884836a75f450ec3cbd567)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:41.659157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: WARNING py.warnings [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:22:41.659157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: warnings.warn(msg) Aug 29 20:22:41.659157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: Aug 29 20:22:41.664211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:41.825449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f97e78e27884836a75f450ec3cbd567', 'request_id': 'req-6c5f190a-1d74-4b69-9d81-bdd51140df2e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:41.863609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f97e78e27884836a75f450ec3cbd567', 'request_id': 'req-6c5f190a-1d74-4b69-9d81-bdd51140df2e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:41.885423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f97e78e27884836a75f450ec3cbd567', 'request_id': 'req-6c5f190a-1d74-4b69-9d81-bdd51140df2e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:41.920545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] The token cache is being invalidate because project 6f97e78e27884836a75f450ec3cbd567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:41.921129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:41.925019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6c5f190a-1d74-4b69-9d81-bdd51140df2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:41.928212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 829/1674] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:41 2022] DELETE /identity/v3/projects/6f97e78e27884836a75f450ec3cbd567 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:41.934293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:41.945701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291784e-b343-4afd-a5ac-c9ccf70e0da1 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:42.021710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a71-b34b-41a8-a7e9-601ed8d107f6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.021811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a71-b34b-41a8-a7e9-601ed8d107f6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.022052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a71-b34b-41a8-a7e9-601ed8d107f6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.024333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 830/1675] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 29 20:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:42.039006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.039517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.040336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.157958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:42.158940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.159357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.159759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:42.159958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] PATH_INFO: `/v3/users/53ce1b71e3c84503939d4b03fa72b307` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.161591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ce1b71e3c84503939d4b03fa72b307)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:42.164076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:42.166829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.184878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:42.286674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:42.329892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ce1b71e3c84503939d4b03fa72b307'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.371442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ce1b71e3c84503939d4b03fa72b307'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.398725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ce1b71e3c84503939d4b03fa72b307'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.405444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ce1b71e3c84503939d4b03fa72b307'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.416322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 831/1676] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:42.427866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ce1b71e3c84503939d4b03fa72b307'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.439721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 846/1677] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:41 2022] DELETE /identity/v3/users/53ce1b71e3c84503939d4b03fa72b307 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:42.486818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:42.488608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.507794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592b2cc-6224-494d-8bb6-33620af526e2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:42.718468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:42.719820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.720294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.720996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.724281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.752964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:42.755289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:42.782379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 832/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:43.742478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:43.744580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:43.973613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e1519-c6ab-4e20-9da0-1c52d239a9cf admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:44.010760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:44.012005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.012632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.013195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] PATH_INFO: `/v3/projects/ecbaac88c6734c1ba87a43b94438d091` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.025801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbaac88c6734c1ba87a43b94438d091)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:44.028515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:44.145719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbaac88c6734c1ba87a43b94438d091', 'request_id': 'req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.166480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbaac88c6734c1ba87a43b94438d091', 'request_id': 'req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.183622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbaac88c6734c1ba87a43b94438d091', 'request_id': 'req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.194100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:44.195818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:44.227508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] The token cache is being invalidate because project ecbaac88c6734c1ba87a43b94438d091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:44.228092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.229713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.239750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 847/1679] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:43 2022] DELETE /identity/v3/projects/ecbaac88c6734c1ba87a43b94438d091 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:44.244886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:44.247794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d71c7-e46f-4f43-a4f2-45a92af2308b service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:44.260486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:44.422609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:44.436573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:44.439380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.441009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.441445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] PATH_INFO: `/v3/projects/9f363ea9a5864521be40a8d4742f19c8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.447398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f363ea9a5864521be40a8d4742f19c8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:44.451098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:44.502831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2d86-2a40-4bfe-aa59-3b9d195417d0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:44.531768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:44.532709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.532941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.533260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] PATH_INFO: `/v3/users/b1f3bdd9142b498fafc7fe3f3e37343f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.536517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f3bdd9142b498fafc7fe3f3e37343f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:44.540277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:44.562333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f363ea9a5864521be40a8d4742f19c8', 'request_id': 'req-104becbf-fa91-49dd-a940-1885cf6d269d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.582045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f363ea9a5864521be40a8d4742f19c8', 'request_id': 'req-104becbf-fa91-49dd-a940-1885cf6d269d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.598462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f363ea9a5864521be40a8d4742f19c8', 'request_id': 'req-104becbf-fa91-49dd-a940-1885cf6d269d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.604404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:44.622370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] The token cache is being invalidate because project 9f363ea9a5864521be40a8d4742f19c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:44.622836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.623781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.633616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 833/1680] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:44 2022] DELETE /identity/v3/projects/9f363ea9a5864521be40a8d4742f19c8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:44.634860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:44.636959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:44.678419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f3bdd9142b498fafc7fe3f3e37343f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.715825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f3bdd9142b498fafc7fe3f3e37343f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.738387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f3bdd9142b498fafc7fe3f3e37343f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.740917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f3bdd9142b498fafc7fe3f3e37343f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.774640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a39d2d77-941b-49a9-a722-5377990ba021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f3bdd9142b498fafc7fe3f3e37343f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:44.789493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 848/1681] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:44 2022] DELETE /identity/v3/users/b1f3bdd9142b498fafc7fe3f3e37343f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:44.791456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc463-1d0c-4a74-8e13-daa25efb6740 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.792120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc463-1d0c-4a74-8e13-daa25efb6740 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.792940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc463-1d0c-4a74-8e13-daa25efb6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.817081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104becbf-fa91-49dd-a940-1885cf6d269d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:44.841133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-522cc463-1d0c-4a74-8e13-daa25efb6740 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:44.844178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-522cc463-1d0c-4a74-8e13-daa25efb6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:44.968797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 849/1682] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:44.990018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.990238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:44.990426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.990670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:44.990980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:44.991209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] PATH_INFO: `/v3/projects/4db9d633157e4379a6488cb03ec6a945` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.993207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:44.993811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db9d633157e4379a6488cb03ec6a945)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:44.995766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.038736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:45.044966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.061981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 850/1683] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:45.067410 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.117653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc00f0-d03e-43ed-9ff0-3f2e35155120 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:45.141225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db9d633157e4379a6488cb03ec6a945', 'request_id': 'req-414cb957-d1b9-4319-bc52-4509d5841d34'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:45.166329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db9d633157e4379a6488cb03ec6a945', 'request_id': 'req-414cb957-d1b9-4319-bc52-4509d5841d34'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:45.191965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db9d633157e4379a6488cb03ec6a945', 'request_id': 'req-414cb957-d1b9-4319-bc52-4509d5841d34'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:45.262542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] The token cache is being invalidate because project 4db9d633157e4379a6488cb03ec6a945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:45.263003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:45.264613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-414cb957-d1b9-4319-bc52-4509d5841d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:45.271085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 834/1684] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:44 2022] DELETE /identity/v3/projects/4db9d633157e4379a6488cb03ec6a945 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:45.276043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99611-6713-44bd-a2b8-48f566580468 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.276258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99611-6713-44bd-a2b8-48f566580468 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.276596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c99611-6713-44bd-a2b8-48f566580468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.319135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:45.338893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:45.339803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.340130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.340707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.341766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:45.342086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:45.343853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.364219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-67c99611-6713-44bd-a2b8-48f566580468 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:45.366013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-67c99611-6713-44bd-a2b8-48f566580468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.378576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 835/1685] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:45.391364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 851/1686] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:45.391643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.391643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.393217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.393351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.397745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.432881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c3280-6926-41af-93a7-593d92b94579 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:45.443633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:45.444272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.444593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.444859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.445506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:45.448025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:45.449410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.452702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.469981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 836/1687] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:45.473051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.494313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0747-3d07-489d-99fb-4137d12a3a0c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:45.515791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:45.518568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.518939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.519380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.520457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:45.521741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:45.529332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.536241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 852/1688] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:45 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:45.537431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.576034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 837/1689] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:45.577970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.593615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:45.603831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4cbb2-9e92-4d2f-b949-4692c216e4e8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:45.729896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff13ea-9043-4e8a-9e8f-64b75446dd63 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:45.759440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:45.760093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.760434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.761149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.761345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:45.771631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.814359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:45.815280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:45.815769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:45.816229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:45.817218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:45.823177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:45.845081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 853/1690] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:45 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:45.846096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:45.849768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:45.887030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 838/1691] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:45 2022] POST /identity/v3/projects => generated 369 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:45.888224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:46.081656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd0da-9538-432c-a3b0-3a45cda48171 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:46.088774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:46.089723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.090112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.090491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.091260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:46.094258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:46.112584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b273142-8a9e-4d5b-9045-9580043ef70e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:46.118398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 839/1692] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:46.118398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:46.185364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490a0d6-6aa3-45ad-95a0-c4d684186450 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:46.209959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:46.213867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.215720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.216319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.217949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:46.224470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:46.283980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 840/1693] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:46 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:46.286415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:46.293577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.335347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:46.368964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8e4b-f37c-49a5-b3ad-c5091a202c22 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:46.369712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:46.370469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.370842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.371150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.375614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.394817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:46.395768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.396183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.396627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] PATH_INFO: `/v3/projects/be9b08b385384b4380a3e52d14529443` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.400635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9b08b385384b4380a3e52d14529443)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:46.402608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:46.408769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:46.413511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc87ab-3a09-44b1-a3a0-abf31e702209 service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:46.446376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 854/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:46.450555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9700d-7d42-406d-9c8b-740fd8028ed9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.450555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9700d-7d42-406d-9c8b-740fd8028ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.450987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9700d-7d42-406d-9c8b-740fd8028ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.522285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e3e9700d-7d42-406d-9c8b-740fd8028ed9 None None] MFA Rules not processed for user `bfacd0a28d2a4dcb90eff48a42f0ffc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:46.523873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e3e9700d-7d42-406d-9c8b-740fd8028ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.557237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9b08b385384b4380a3e52d14529443', 'request_id': 'req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:46.585870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9b08b385384b4380a3e52d14529443', 'request_id': 'req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:46.613347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9b08b385384b4380a3e52d14529443', 'request_id': 'req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:46.618102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:46.632508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] The token cache is being invalidate because project be9b08b385384b4380a3e52d14529443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:46.633627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:46.635326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:46.637906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 841/1695] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:46 2022] DELETE /identity/v3/projects/be9b08b385384b4380a3e52d14529443 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:46.639580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:46.642923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.692442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 855/1696] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:46.692442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a56c-adcc-4da4-b820-986bc2297991 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.692442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a56c-adcc-4da4-b820-986bc2297991 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.692442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a56c-adcc-4da4-b820-986bc2297991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.767107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2771a56c-adcc-4da4-b820-986bc2297991 None None] MFA Rules not processed for user `45c041b057d14b00b494d275bbdb079d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:46.768289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2771a56c-adcc-4da4-b820-986bc2297991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.855299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd0aa0-4656-4a1b-bf4b-05b5a5894963 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:46.871673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:46.872320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.872625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.872901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.873561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:46.875472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:46.905765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 842/1697] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:46.908583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:46.912231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:46.926206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 856/1698] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:46.931050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8c6e-0b4a-453b-be46-845466d04f84 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:46.950143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8c6e-0b4a-453b-be46-845466d04f84 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:46.950143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8c6e-0b4a-453b-be46-845466d04f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:46.984797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f2bf9-67e7-4319-9df3-d262ff4b4324 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.034269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cb7b8c6e-0b4a-453b-be46-845466d04f84 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:47.037686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.039166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cb7b8c6e-0b4a-453b-be46-845466d04f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.039307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.039438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.042036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.042830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.049182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.062147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 857/1699] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:47.065907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5d80-ddb3-4e42-a2a1-517cda2d49aa None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.066296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5d80-ddb3-4e42-a2a1-517cda2d49aa None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.066441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5d80-ddb3-4e42-a2a1-517cda2d49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.087897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 843/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:47.089792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.112973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-935f5d80-ddb3-4e42-a2a1-517cda2d49aa None None] MFA Rules not processed for user `bfacd0a28d2a4dcb90eff48a42f0ffc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:47.115273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-935f5d80-ddb3-4e42-a2a1-517cda2d49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.125779 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 858/1701] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:47.127446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.127835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.128211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.136625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcb1b-64a6-4870-8878-a1b313c32744 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.152890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.154096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.154096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.154096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] PATH_INFO: `/v3/projects/84756c508e664475b8cee3b0a00123c9/users/df9322e60bdc4d0fb2bc7c833549ba55/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.164923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:47.166861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.179633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 859/1702] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:47.180811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.197094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a40759-537f-4c32-8cdd-fcf4860bd1f6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.197798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84756c508e664475b8cee3b0a00123c9, user_id=df9322e60bdc4d0fb2bc7c833549ba55, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.207010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.213535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.214886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.215610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.216012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.217514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.221402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.250004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 860/1704] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:47.252112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.253732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 844/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:47 2022] PUT /identity/v3/projects/84756c508e664475b8cee3b0a00123c9/users/df9322e60bdc4d0fb2bc7c833549ba55/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:47.255653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.260272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.393485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c29da4-b799-4dc1-b291-0cc4ad6c6476 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.398969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.399610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.399892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.400160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.400848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:47.401149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.402789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf822f-a4c7-4d16-b425-e7502b8e78f7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.422375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 845/1705] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:47.422375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.422375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.422375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.441012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:47.461502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] MFA Rules not processed for user `df9322e60bdc4d0fb2bc7c833549ba55`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:47.463203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.481811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05cad5-5d0d-4e26-b588-1513e0227b9b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.517313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:47.584070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 846/1706] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:47.586422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.603937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa9cdd-3c70-4751-806e-a6ff990a177a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.610938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.612059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.612709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.613306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.616668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:47.622066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.624551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.624551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.624551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] PATH_INFO: `/v3/projects/4d1a46e428de400194d102fd4ace0ae1/users/b9231ec2d8e748f09641284125ca29ff/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.650397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1a46e428de400194d102fd4ace0ae1, user_id=b9231ec2d8e748f09641284125ca29ff, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.653979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.696565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 847/1707] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:47 2022] PUT /identity/v3/projects/4d1a46e428de400194d102fd4ace0ae1/users/b9231ec2d8e748f09641284125ca29ff/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:47.696565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.733885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.735899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.747846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 861/1708] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:47.749019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:47.765619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d187-2883-4b72-8e6b-f33f0ee35cb8 service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.869359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e12e-861d-4fc0-a9a9-e178efe0bcd7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:47.879220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.879972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.880253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.880555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.881304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.885963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105eaec-2cad-4487-b10b-de52954a50ba admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.902258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:47.903307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.903796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.904270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.905146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:47.912759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:47.942726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 848/1709] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:47.944042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:47.944326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:47.945166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:47.983549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 862/1710] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:47.984266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.022670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:48.024468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] MFA Rules not processed for user `b9231ec2d8e748f09641284125ca29ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:48.026209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:48.137929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da380-ca7a-4b01-bac0-b13ee79766a5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.143535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.144344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.144781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.145150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.145908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.148640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.192216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 863/1711] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:48.193816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.225240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd690f-ea60-42e9-8845-c5959b214799 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.238113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.240599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.242693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.243204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.244974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.257045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.269464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 849/1712] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:48.271712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.307969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae9b1-dc9c-42de-9b03-06366e8360c5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.311945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 864/1713] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:48 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:48.323906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.329981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.329981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.329981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.329981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.330829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.347823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.384603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 850/1714] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:48.387509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.397466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494c6f-8488-46e7-bde2-35ad9945cf9c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.410624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.411381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.411812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.412129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.412827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.428795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.456174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce9e9a-2b75-4b47-a96d-608b1ad1b947 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.489638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 865/1715] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:48 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:48.494395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.504748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.508013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.508013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.508259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.510631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.517501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.547629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 851/1716] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:48.548677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.573975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:48.587633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad12d73-791b-41ce-bebe-ee0f64dcb4d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.707616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844e82-5ac2-4140-bd0b-b2d4e3b97918 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.720720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.721426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.721704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.721971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.722639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.730581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.749170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.749823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.750136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.751094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.751908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.761123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 866/1717] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:48.761339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.761454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.786134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce7c69-d40b-43a3-b126-ae28e5a3f7ab admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.801240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.803606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.804248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.804647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] PATH_INFO: `/v3/projects/c2672778fb8945acb7d8fcce76c13ca7/users/7cfc7b4ae0c14bb8b8600b7bf6922694/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.819330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 852/1718] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:48 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:48.820306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.830550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2672778fb8945acb7d8fcce76c13ca7, user_id=7cfc7b4ae0c14bb8b8600b7bf6922694, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.837634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.849100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468dc3-2544-41b6-b4b4-78b20698219f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:48.858993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:48.860835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:48.861127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:48.861406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] PATH_INFO: `/v3/projects/db610de8f672418db6f4b16919546995/users/152b8ffcfca0443182bdb9b19eea45ac/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:48.867734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 867/1719] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:48 2022] PUT /identity/v3/projects/c2672778fb8945acb7d8fcce76c13ca7/users/7cfc7b4ae0c14bb8b8600b7bf6922694/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:48.870389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.926357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db610de8f672418db6f4b16919546995, user_id=152b8ffcfca0443182bdb9b19eea45ac, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:48.933479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:48.971281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 853/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:48 2022] PUT /identity/v3/projects/db610de8f672418db6f4b16919546995/users/152b8ffcfca0443182bdb9b19eea45ac/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:48.972594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:48.994984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.069656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70091-7d48-43f4-b7bc-8aeb0fd12255 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:49.142195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba53dd0-caa7-4712-a9ff-83bad5904bd5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:49.154603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:49.155245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.155520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.155834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.158673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:49.160452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd213-7d08-4c68-8c25-2b3d6d1bd440 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:49.182560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 854/1721] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:49.185433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508683f-46b7-470e-855a-a730c5fd5168 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.187033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508683f-46b7-470e-855a-a730c5fd5168 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.187033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508683f-46b7-470e-855a-a730c5fd5168 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.206209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 855/1722] 10.222.0.20 () {54 vars in 912 bytes} [Mon Aug 29 20:22:49 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:22:49.207618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.208011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.208441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.247892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:49.249911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.250288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.250560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.251239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:49.258241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:49.282008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 868/1723] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:49.283072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:49.310701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28409d-6887-4d73-af42-691d4077425c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:49.318893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] MFA Rules not processed for user `152b8ffcfca0443182bdb9b19eea45ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.321101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.326561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:49.327359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.327526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.327931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] PATH_INFO: `/v3/projects/c2672778fb8945acb7d8fcce76c13ca7/users/7cfc7b4ae0c14bb8b8600b7bf6922694/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.332950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2672778fb8945acb7d8fcce76c13ca7, user_id=7cfc7b4ae0c14bb8b8600b7bf6922694, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:49.340334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017f1ae-10ee-40ca-b003-4ee7aefa1bc4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:49.375044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 869/1724] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:49 2022] PUT /identity/v3/projects/c2672778fb8945acb7d8fcce76c13ca7/users/7cfc7b4ae0c14bb8b8600b7bf6922694/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:49.377864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a02c69-5fee-4c4a-94e9-be00f69c955f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.378156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a02c69-5fee-4c4a-94e9-be00f69c955f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.378424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a02c69-5fee-4c4a-94e9-be00f69c955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.455530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.456218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-54a02c69-5fee-4c4a-94e9-be00f69c955f None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.461498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-54a02c69-5fee-4c4a-94e9-be00f69c955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.472218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 856/1725] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.473125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:49.503356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947ad8-aa41-4c87-9360-6eeb3b5ada62 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:49.595618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 870/1726] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.596842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.597196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.597528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.662251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:49.663395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.663970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.664517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] PATH_INFO: `/v3/projects/ddb197c0872041a9bfd141a66dcd3528/users/a55b66a5736440778fecc90366ce523d/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.665219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] MFA Rules not processed for user `7cfc7b4ae0c14bb8b8600b7bf6922694`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.667667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.703183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb197c0872041a9bfd141a66dcd3528, user_id=a55b66a5736440778fecc90366ce523d, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:49.722295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c28a-7fb2-4116-a682-5e477b4eb1ee admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:49.781683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 857/1727] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:49 2022] PUT /identity/v3/projects/ddb197c0872041a9bfd141a66dcd3528/users/a55b66a5736440778fecc90366ce523d/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:49.786315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:49.787287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:49.788638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:49.860518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:49.886629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 871/1728] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:49.888566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] MFA Rules not processed for user `7e552e85d3ba484baf73a5b9dc88764c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:49.895500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.896835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:49.898646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:49.931690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0529-608c-498f-b1b9-0c25773ec31d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.112591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.113622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.116630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.117057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] PATH_INFO: `/v3/users/d2e42382876f4d9caf93c645099719cd` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.123641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e42382876f4d9caf93c645099719cd)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.134977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.168831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 858/1729] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:50.168831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:50.201515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15ef6f-2180-473a-bc48-440fa7b694dc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.224687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.225136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.225389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.226677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.228761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.233628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.280409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 859/1730] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:50.282001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:50.285857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.306950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e42382876f4d9caf93c645099719cd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:50.333522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e42382876f4d9caf93c645099719cd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:50.350529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e42382876f4d9caf93c645099719cd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:50.370874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e42382876f4d9caf93c645099719cd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:50.386702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:50.416062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e42382876f4d9caf93c645099719cd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:50.417104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734257-c51a-4112-b6ae-9573ab9fdf4f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.429598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.432289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.432979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.434127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.437252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.445471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 872/1731] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:49 2022] DELETE /identity/v3/users/d2e42382876f4d9caf93c645099719cd => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:50.449294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:50.453368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.463099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.466258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.528227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 860/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:50.541143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:50.562254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.676963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2abc-6599-4465-ac18-55210bd5454f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.700786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.700786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.701186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.702441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.705219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:50.710606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:50.792091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 873/1733] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:50.793640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:50.797614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fef1-6b91-4430-874e-9549fcaee141 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:50.804626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:50.871026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:50.954367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:50.955016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:50.960110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:50.960495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:50.963475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.197709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:51.199124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:51.212311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443371f0-bd7e-493a-961a-e94ac5f3ebe8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:51.222295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 861/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:51.234521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:51.234710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:51.235635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.236090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.237414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.242630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.244948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.301314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7d00-9338-49ab-b350-e816815fa198 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:51.315531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:51.316181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.316510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.316784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.317435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:51.324335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbc7b7-c126-4796-9166-1720e37ecc9b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:51.410888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 862/1735] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:51 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:51.414008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4717-f41f-4ff8-93db-b22583b9b2be None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.414296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4717-f41f-4ff8-93db-b22583b9b2be None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.414575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4717-f41f-4ff8-93db-b22583b9b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.488597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-15ba4717-f41f-4ff8-93db-b22583b9b2be None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:51.491164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15ba4717-f41f-4ff8-93db-b22583b9b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.503501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 863/1736] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:51.504942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.505322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.506052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.511711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:51.514173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:51.541119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 874/1737] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:51.542487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:51.557146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626b2d4-dc3a-4bfa-981b-8cf35638388c service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:51.562530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:51.563280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.563655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.563934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] PATH_INFO: `/v3/projects/ddb197c0872041a9bfd141a66dcd3528/users/a55b66a5736440778fecc90366ce523d/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.566401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb197c0872041a9bfd141a66dcd3528, user_id=a55b66a5736440778fecc90366ce523d, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:51.569792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:51.601304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 875/1738] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:51 2022] PUT /identity/v3/projects/ddb197c0872041a9bfd141a66dcd3528/users/a55b66a5736440778fecc90366ce523d/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:51.612643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:51.657810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:51.674163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:51.679027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.751351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4870f3-f48d-4618-bea3-2da0bd265942 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:51.764550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:51.767181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.767467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.767741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.768467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:51.776605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:51.802485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 876/1739] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:51.805520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:51.892106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 864/1740] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:51.919077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:51.930444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:51.943566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:51.975408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f8ad-ffc4-42b0-b5a7-1f9483b10cf5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:51.986247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:51.987268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:51.989315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:51.990917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:51.994642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:52.222271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:52.224945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3da278-68bc-4a5b-b864-2a93fbefabb4 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:52.269007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 877/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:52.273044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.276167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.276585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.284144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69bb06-fe2d-4bae-b830-520ac01f46c4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:52.306147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:52.309292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.309547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.309821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.345688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:52.350428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:52.365828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 865/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:52.392111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:52.444672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdd8f5-a9f7-44c7-b3fb-9712e62de919 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:52.474353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:52.478160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.478684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.479341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] PATH_INFO: `/v3/projects/dd5143ce58f24a729495567e4edaa666/users/5c283d39e9024ff0bdabee0e26407c6a/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.494097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] MFA Rules not processed for user `a55b66a5736440778fecc90366ce523d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:52.501361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:52.517733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5143ce58f24a729495567e4edaa666, user_id=5c283d39e9024ff0bdabee0e26407c6a, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:52.523050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:52.555081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 866/1743] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:52 2022] PUT /identity/v3/projects/dd5143ce58f24a729495567e4edaa666/users/5c283d39e9024ff0bdabee0e26407c6a/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:52.557191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:52.565469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:52.872119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:52.885042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400575a5-2051-4495-af10-c48e1e1d27b5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:52.903775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:52.905504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:52.908028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:52.909448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:52.943339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 878/1744] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 673 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:52.949938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:53.007915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618745d6-5cae-4981-a6ee-39b8914b6dcf None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:53.168212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.175633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.226254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 867/1745] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:22:53.241375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:53.248850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:53.395906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:53.401505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.401786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.402059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.414879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.422705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.507937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 879/1746] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:53.532543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:53.557448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521a18-ff7a-4817-9c72-d025caf6cd8d service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:53.573173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:53.573833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.574114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.578345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.626205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be3348-af8a-4537-83df-8009c69b9c18 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:53.673141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:53.678642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.678922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.679196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] PATH_INFO: `/v3/projects/dd5143ce58f24a729495567e4edaa666/users/5c283d39e9024ff0bdabee0e26407c6a/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.703068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5143ce58f24a729495567e4edaa666, user_id=5c283d39e9024ff0bdabee0e26407c6a, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.731386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd643a3-9a6d-4569-af20-ac248ae193b9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.767551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:53.768928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:53.777042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25019e20-9092-4079-a080-7120e80f3ddb service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:53.830090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 880/1747] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:53 2022] PUT /identity/v3/projects/dd5143ce58f24a729495567e4edaa666/users/5c283d39e9024ff0bdabee0e26407c6a/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:53.835019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.835374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.835646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.836856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:53.856778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:53.865933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:53.867130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:53.976850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:54.007942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:54.055348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] MFA Rules not processed for user `5c283d39e9024ff0bdabee0e26407c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:54.067963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:54.340236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:54.362340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 881/1749] 10.222.0.71 () {58 vars in 1015 bytes} [Mon Aug 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:54.363212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:54.373054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:54.468486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 869/1750] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 613 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:54.468486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:54.483975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:54.537588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863be51-3e93-4c54-968f-2842f31aab8f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:54.568252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:54.576093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:54.576434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:54.579165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:54.603285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:54.608071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:54.633810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 870/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:54.763920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f671a-18f1-42e1-af2d-0a01eae18e38 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:54.794076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:54.794861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:54.795147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:54.795452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] PATH_INFO: `/v3/projects/9339228b6135425eb93c8982dcdefeaf` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:54.806112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:54.819060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9339228b6135425eb93c8982dcdefeaf)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:54.829975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:55.089863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9339228b6135425eb93c8982dcdefeaf', 'request_id': 'req-8cefa1f2-adfc-465d-b4af-0e539971d123'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:55.140437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9339228b6135425eb93c8982dcdefeaf', 'request_id': 'req-8cefa1f2-adfc-465d-b4af-0e539971d123'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:55.163494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba3e3a-d221-40bc-a084-2b5bdc179762 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:55.175610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9339228b6135425eb93c8982dcdefeaf', 'request_id': 'req-8cefa1f2-adfc-465d-b4af-0e539971d123'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:55.230597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] The token cache is being invalidate because project 9339228b6135425eb93c8982dcdefeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:55.237244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:55.238695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8cefa1f2-adfc-465d-b4af-0e539971d123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:55.249490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 882/1752] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:54 2022] DELETE /identity/v3/projects/9339228b6135425eb93c8982dcdefeaf => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:55.267044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.267693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.268169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.285496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:55.286440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.289429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.290983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.298774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:55.355647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:55.366821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:55.505922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:55.624152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:55.627953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edccd82-25ea-4ade-95c3-56120fd22fa1 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:55.694300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 871/1753] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 889 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:55.727088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.727436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.727649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.733111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 883/1754] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:55.821370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:55.826349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:55.877449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 872/1755] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:55.882482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:55.897295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93708423-98df-468a-bfb8-ef7c1f1993e2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:55.903148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:55.904081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:55.904569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:55.905034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:55.905982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:55.907224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:55.910857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:55.933492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 884/1756] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:55.938051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:55.972161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a23e8-7dd4-484e-9194-07fc1b7abd11 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.012722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.020457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.022095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.022478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.030404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.044489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:56.262526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 873/1757] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:55 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:56.266001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.283611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd74-1056-4cc7-8c65-edeedf553090 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.383151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.386210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.403799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:56.570169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.573074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.573469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.573691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.574393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.589933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:56.683021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 885/1758] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:56 2022] POST /identity/v3/users => generated 290 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:56.689287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.731298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f30007-f352-40b8-9f6c-963ada08f7dc admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.752950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.753597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.753875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.754141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.754802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.756501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:56.788211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 886/1759] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:56.791273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.795437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a0624-a8a3-4a1e-8602-3e5a4e9d5e4a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.808733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.810535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.810825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.812952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.816858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:56.818024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fdbd8-8451-4dc7-82c4-2b07a33f6bf3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.834539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.835178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.835458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.835726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.836451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.838060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:56.898889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 887/1760] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:56.904549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:56.935216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb860d-d75a-4464-97a7-47c3e50ecfee admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:56.950186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:56.951175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:56.951874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:56.952297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] PATH_INFO: `/v3/projects/0012a27bae5b41b6999081fa30b37905/users/f1c14871725042df93a2112145e54006/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:56.974850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0012a27bae5b41b6999081fa30b37905, user_id=f1c14871725042df93a2112145e54006, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:56.998639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c23d75-bc1e-4754-91b2-f35968f44462 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.021570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:57.026046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.070403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 888/1761] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:56 2022] PUT /identity/v3/projects/0012a27bae5b41b6999081fa30b37905/users/f1c14871725042df93a2112145e54006/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:57.087298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.088156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.091497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.102437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 874/1762] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:57.159107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] MFA Rules not processed for user `f1c14871725042df93a2112145e54006`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:57.160902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:57.304722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:57.324558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 889/1763] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:57.337080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:57.359334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c675b-cba8-45ea-8139-ea84e3619db7 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:57.471278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:57.473220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.473689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.474191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.475367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:57.479459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.528018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 875/1764] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:57 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:57.533560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:57.552002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200171-fcfe-47a5-a4cd-f7aff1a8318b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:57.742475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:57.744731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.745920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.746341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.747563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:57.756458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.814153 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 890/1765] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:57 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:57.817904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:57.833659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87067c-8a3b-4936-a7da-53895d75d0c8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:57.844224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:57.847758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.848076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.848360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.855743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:57.861981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:57.900332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 876/1766] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:57.904285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:57.924092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40db8c-a059-4c87-9264-a9874e932bfa admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:57.935995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:57.936868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:57.937152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:57.937430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] PATH_INFO: `/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8/users/f321d1e56545464c976f602d7d4c4021/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:57.995951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b7daabefbd4279ae4b0521bb0b57c8, user_id=f321d1e56545464c976f602d7d4c4021, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:58.004937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:58.038303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 891/1767] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:57 2022] PUT /identity/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8/users/f321d1e56545464c976f602d7d4c4021/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:58.045918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:58.068199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f0dfc-e174-4eb5-a8d9-9163f1829658 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:58.225754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:58.314906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:58.315592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:58.315871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:58.316143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:58.316870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:58.319351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118340-fc75-4172-89d8-70d5f1f0f4bd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:58.362922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 877/1768] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:58.367382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:58.390086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7817-2442-41d6-80e3-60d79a98fa34 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:58.402278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:58.403492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:58.405389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:58.405675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] PATH_INFO: `/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8/users/f321d1e56545464c976f602d7d4c4021/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:58.411838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b7daabefbd4279ae4b0521bb0b57c8, user_id=f321d1e56545464c976f602d7d4c4021, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:58.418971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:58.479084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:58.479530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:58.479986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:58.497295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 892/1769] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:58 2022] PUT /identity/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8/users/f321d1e56545464c976f602d7d4c4021/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:58.590233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] MFA Rules not processed for user `f321d1e56545464c976f602d7d4c4021`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:58.592114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:58.915267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 878/1770] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:59.065910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:59.068938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:59.185581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ca21-e69f-4ac0-ab4d-5b688460f125 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:59.193663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:59.195182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:59.195704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:59.196324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:59.393763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:59.399772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4215256-9741-4752-ae68-2eea7ddb2201 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:59.439837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 893/1771] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:00.069763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:00.072010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.284014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c869599-01da-4a37-9b22-4cacae687ddf None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:00.297473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:00.298840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.299420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.300012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] PATH_INFO: `/v3/users/152b8ffcfca0443182bdb9b19eea45ac` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.302225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152b8ffcfca0443182bdb9b19eea45ac)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:00.306258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:00.473030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152b8ffcfca0443182bdb9b19eea45ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:00.490215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.511058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152b8ffcfca0443182bdb9b19eea45ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:00.511940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152b8ffcfca0443182bdb9b19eea45ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:00.538470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152b8ffcfca0443182bdb9b19eea45ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:00.539389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152b8ffcfca0443182bdb9b19eea45ac'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:00.574916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 879/1772] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:00 2022] DELETE /identity/v3/users/152b8ffcfca0443182bdb9b19eea45ac => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:00.583173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:00.584806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:00.585501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:00.601266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:00.657439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:00.663704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:00.992665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 894/1773] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:01.094761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:01.097814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:01.397722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bc4e-cfcf-4cb5-b7ac-e24059f90ff1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:01.402506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:01.404308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:01.404842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:01.405317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:01.460095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:01.462409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59892c-8b69-481d-9430-a8eef24ac5d8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:01.497361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 880/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:01.871079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:01.873331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:02.063973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a13cc-4ddc-4d91-a147-f19555ce6ed4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:02.079512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:02.081154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:02.082659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:02.083680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:02.093008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:02.148847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ae235-409e-432a-8396-64a1189cae06 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:02.149955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ae235-409e-432a-8396-64a1189cae06 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:02.150430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ae235-409e-432a-8396-64a1189cae06 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:02.153268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 881/1775] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:02.201129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:02.220326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:02.220326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:02.275619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:02.277542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:02.327039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:02.335664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd3a69-45f3-4c0b-97d6-657cea875022 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:02.432537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 895/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:02.435247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:02.435589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:02.436027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:02.514103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 882/1777] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:02.519327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] MFA Rules not processed for user `7e552e85d3ba484baf73a5b9dc88764c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:02.520607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:02.592510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:02.595544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:02.650063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fabf5-0b05-4500-92bb-dde712e9b147 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:02.690497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:02.692674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:02.697190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:02.699486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:02.699486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:02.733549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 896/1778] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:02.756700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:02.762165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866e345-3b48-448a-a06a-0f5bc1d8b1a6 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:02.859268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 883/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:03.272204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:03.274764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:03.335740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167108-f53f-4e6b-8452-e1cab3e89e5d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:03.394630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:03.395780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.396251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.399367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] PATH_INFO: `/v3/users/a89623c2adae4bd2adc9e1d6ac29d7bd` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.415326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89623c2adae4bd2adc9e1d6ac29d7bd)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:03.424761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:03.672386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89623c2adae4bd2adc9e1d6ac29d7bd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:03.698583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89623c2adae4bd2adc9e1d6ac29d7bd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:03.730660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89623c2adae4bd2adc9e1d6ac29d7bd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:03.733547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89623c2adae4bd2adc9e1d6ac29d7bd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:03.818534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89623c2adae4bd2adc9e1d6ac29d7bd'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:03.855470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 897/1780] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:03 2022] DELETE /identity/v3/users/a89623c2adae4bd2adc9e1d6ac29d7bd => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:03.861668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:03.862529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:03.862529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:03.939056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:03.948783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.161830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:04.235514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 884/1781] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:04.316351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:04.318900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:04.673531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd35af-3fa8-4715-bcbf-5efb8b6664c3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:04.691121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:04.691962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:04.697558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:04.698041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:04.758512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:04.760220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:04.823350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 898/1782] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:05.161542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:05.165186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:05.235611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84f811-5fb3-4d8f-9fc8-f427c6696346 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:05.262802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:05.265587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:05.266180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:05.266436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] PATH_INFO: `/v3/users/b9231ec2d8e748f09641284125ca29ff` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:05.278068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9231ec2d8e748f09641284125ca29ff)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:05.290217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:05.413520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:05.415642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:05.454945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89251-6134-4486-bfd2-5abc1723e4b3 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:05.477512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:05.478001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:05.478162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:05.478513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] PATH_INFO: `/v3/projects/db610de8f672418db6f4b16919546995` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:05.485013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db610de8f672418db6f4b16919546995)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:05.493392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:05.509978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9231ec2d8e748f09641284125ca29ff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.624467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9231ec2d8e748f09641284125ca29ff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.628821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9231ec2d8e748f09641284125ca29ff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.685197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9231ec2d8e748f09641284125ca29ff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.686815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b371f405-8ada-4100-bf83-438e354b97a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9231ec2d8e748f09641284125ca29ff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.690277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db610de8f672418db6f4b16919546995', 'request_id': 'req-1cdef42c-8282-4c0b-9a6d-6b19855b018f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.715018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db610de8f672418db6f4b16919546995', 'request_id': 'req-1cdef42c-8282-4c0b-9a6d-6b19855b018f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.744179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 885/1783] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:05 2022] DELETE /identity/v3/users/b9231ec2d8e748f09641284125ca29ff => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:05.750045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:05.751594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:05.753182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:05.754603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db610de8f672418db6f4b16919546995', 'request_id': 'req-1cdef42c-8282-4c0b-9a6d-6b19855b018f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.766377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:05.845878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] The token cache is being invalidate because project db610de8f672418db6f4b16919546995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:05.846425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.850147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:05.864248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 899/1784] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:05 2022] DELETE /identity/v3/projects/db610de8f672418db6f4b16919546995 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:05.870427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:05.874863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:05.886222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:05.890179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:06.214703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 886/1785] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:06.336207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdef42c-8282-4c0b-9a6d-6b19855b018f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:06.355437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:06.357403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:06.361559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:06.363656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] PATH_INFO: `/v3/users/5c283d39e9024ff0bdabee0e26407c6a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:06.384622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c283d39e9024ff0bdabee0e26407c6a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:06.384622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:06.407647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:06.413785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:06.517800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c283d39e9024ff0bdabee0e26407c6a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:06.535444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c283d39e9024ff0bdabee0e26407c6a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:06.568668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c283d39e9024ff0bdabee0e26407c6a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:06.573417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c283d39e9024ff0bdabee0e26407c6a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:06.600273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77b1d-ba36-456a-850e-fc73e7006b4b None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:06.609136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:06.609846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:06.612606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:06.612925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:06.614286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c283d39e9024ff0bdabee0e26407c6a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:06.621160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:06.633838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 900/1786] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:05 2022] DELETE /identity/v3/users/5c283d39e9024ff0bdabee0e26407c6a => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:06.643180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:06.645223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be21037-7195-4e2c-9d90-e1117f7a66f8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:06.660801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 887/1787] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:06.785549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:06.787762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.003048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568da9d-4ed0-4c32-8d08-a6c10e3d5dd8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:07.010183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:07.011248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.012116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.012637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] PATH_INFO: `/v3/projects/7542c2dc6f13404999692f82c38bdfd9` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.015528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7542c2dc6f13404999692f82c38bdfd9)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:07.018857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:07.121632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.259505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7542c2dc6f13404999692f82c38bdfd9', 'request_id': 'req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.274463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7542c2dc6f13404999692f82c38bdfd9', 'request_id': 'req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.302426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7542c2dc6f13404999692f82c38bdfd9', 'request_id': 'req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.351166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446773e-6d4f-48ea-a6c4-23555008aeac None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.353331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446773e-6d4f-48ea-a6c4-23555008aeac None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.354227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446773e-6d4f-48ea-a6c4-23555008aeac None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.356217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 888/1788] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:23:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:07.373446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] The token cache is being invalidate because project 7542c2dc6f13404999692f82c38bdfd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:07.373806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.377884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.393328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.394278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.395120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.397800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 901/1789] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:06 2022] DELETE /identity/v3/projects/7542c2dc6f13404999692f82c38bdfd9 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:07.402306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:07.416945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.498732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:07.505020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.544251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:07.708351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc901c-d47f-49a9-ba97-96fb17b1c5b9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:07.725122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:07.728484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.729071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.729602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] PATH_INFO: `/v3/users/20c401e8ce504cd0a3c6c308f9170875` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.731929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c401e8ce504cd0a3c6c308f9170875)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:07.735631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:07.739459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 889/1790] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:07.740860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:07.747990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:07.805924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d5ee-d820-4d1d-83b1-c435701ace7f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:07.824210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:07.826937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:07.834502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:07.836257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] PATH_INFO: `/v3/users/f1c14871725042df93a2112145e54006` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:07.841071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c14871725042df93a2112145e54006)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:07.845188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:07.889330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c401e8ce504cd0a3c6c308f9170875'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.928653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c401e8ce504cd0a3c6c308f9170875'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.959650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c401e8ce504cd0a3c6c308f9170875'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.962154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c401e8ce504cd0a3c6c308f9170875'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:07.994921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c401e8ce504cd0a3c6c308f9170875'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.012443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 902/1791] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:07 2022] DELETE /identity/v3/users/20c401e8ce504cd0a3c6c308f9170875 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:08.012673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c14871725042df93a2112145e54006'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.060560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c14871725042df93a2112145e54006'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.061385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c14871725042df93a2112145e54006'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.085953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c14871725042df93a2112145e54006'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.097793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5883ce9e-3987-47ea-a229-3cf55cabe0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c14871725042df93a2112145e54006'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.108546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:08.111754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.128570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 890/1792] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:07 2022] DELETE /identity/v3/users/f1c14871725042df93a2112145e54006 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:08.134419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.134652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.135122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:08.178475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:08.215674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:08.217492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.401039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38618de3-a1a2-4a7e-99fb-54b2bfd82a04 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:08.447676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 891/1793] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:08.451842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:08.459405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.488681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635f15c-a525-4a41-9fd1-9794846ab99c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:08.502650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:08.504964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.505422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.505846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] PATH_INFO: `/v3/projects/dd5143ce58f24a729495567e4edaa666` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:08.507321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5143ce58f24a729495567e4edaa666)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:08.509521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:08.529958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:08.651747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5143ce58f24a729495567e4edaa666', 'request_id': 'req-c00cc988-839e-41dc-bc4b-669beb8cf580'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.676336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5143ce58f24a729495567e4edaa666', 'request_id': 'req-c00cc988-839e-41dc-bc4b-669beb8cf580'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.694199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5143ce58f24a729495567e4edaa666', 'request_id': 'req-c00cc988-839e-41dc-bc4b-669beb8cf580'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.736036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] The token cache is being invalidate because project dd5143ce58f24a729495567e4edaa666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:08.736609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.738969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:08.742811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 892/1794] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:08 2022] DELETE /identity/v3/projects/dd5143ce58f24a729495567e4edaa666 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:08.754575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:08.757227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.758996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:08.760309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.761264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.761710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:08.764616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.782619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:08.785417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd72c5-b4a5-4247-b0fa-a77b7fab5b7f service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:08.799968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 903/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:08.811626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266d2-c5a0-4853-bfc8-3ddd9137dd6d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.812856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266d2-c5a0-4853-bfc8-3ddd9137dd6d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.813147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266d2-c5a0-4853-bfc8-3ddd9137dd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:08.867523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dd4266d2-c5a0-4853-bfc8-3ddd9137dd6d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:08.869230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dd4266d2-c5a0-4853-bfc8-3ddd9137dd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:08.974811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cc988-839e-41dc-bc4b-669beb8cf580 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:08.989280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:08.990511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:08.991076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:08.991407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.000204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.130121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 904/1796] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:09.147388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.147388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.147388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.189072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:09.194792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.206458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.208033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 905/1797] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:09.209890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.216321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.242747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 893/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:09.252334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241033-3abf-48ab-8304-cf2d88ab07c9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.266900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.267579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.270264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.270677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.272732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:09.273083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.276064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.315456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 906/1799] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:09.323854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.343609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae99f0-1d1e-4a7f-9801-aa5d91010e93 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.355735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.371621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.371621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.371621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.371621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.373886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.377476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.377754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.404814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c1010-bdfd-4989-aec2-c966c0971be3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.430285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685152e8-761a-4898-880e-c287622291de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.431147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685152e8-761a-4898-880e-c287622291de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.431713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685152e8-761a-4898-880e-c287622291de admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.432029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 894/1800] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:09 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:09.435765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685152e8-761a-4898-880e-c287622291de admin admin] PATH_INFO: `/v3/projects/4d1a46e428de400194d102fd4ace0ae1` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.436502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685152e8-761a-4898-880e-c287622291de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1a46e428de400194d102fd4ace0ae1)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.438046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.439649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685152e8-761a-4898-880e-c287622291de admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.482928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:09.485934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:09.535202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1a46e428de400194d102fd4ace0ae1', 'request_id': 'req-685152e8-761a-4898-880e-c287622291de'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.543649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1c3aa-5d92-49bd-b1a5-1011a473ba3c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.547102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1a46e428de400194d102fd4ace0ae1', 'request_id': 'req-685152e8-761a-4898-880e-c287622291de'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.562406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1a46e428de400194d102fd4ace0ae1', 'request_id': 'req-685152e8-761a-4898-880e-c287622291de'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.614007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] The token cache is being invalidate because project 4d1a46e428de400194d102fd4ace0ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:09.614498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.617860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-685152e8-761a-4898-880e-c287622291de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.630956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 907/1801] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:09 2022] DELETE /identity/v3/projects/4d1a46e428de400194d102fd4ace0ae1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:09.632769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685152e8-761a-4898-880e-c287622291de admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.636200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.636910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.637518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.637518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.637716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-685152e8-761a-4898-880e-c287622291de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.638095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.640483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.674031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 895/1802] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:09 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:09.676759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685152e8-761a-4898-880e-c287622291de admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.678866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.684288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.685364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.686432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.686857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.687294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] PATH_INFO: `/v3/users/a55b66a5736440778fecc90366ce523d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.690426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55b66a5736440778fecc90366ce523d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.694007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.703114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c5d6-4a20-42ef-8f0a-93117bed0b07 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.709946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.710590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.710872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.711479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.712255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.714977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.748733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 896/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:09.750282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.764956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efa890-443e-4e01-a67e-f7fccc4707ef admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.773751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.774610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.774984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.775372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.776188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.778165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.780670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55b66a5736440778fecc90366ce523d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.795818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 897/1804] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:09.798389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.801081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55b66a5736440778fecc90366ce523d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.817407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eaf15-a599-4f6b-8178-a933930440d2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:09.824381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:09.825206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:09.825927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:09.825927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] PATH_INFO: `/v3/projects/5ffd27a014f34cfdbe95fb15b287da64/users/2cf7fc34ce524052aafba9ce57dc6b89/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:09.827336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55b66a5736440778fecc90366ce523d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.828334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55b66a5736440778fecc90366ce523d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.848104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffd27a014f34cfdbe95fb15b287da64, user_id=2cf7fc34ce524052aafba9ce57dc6b89, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:09.851524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:09.856102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55b66a5736440778fecc90366ce523d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:09.870041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 908/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:09 2022] DELETE /identity/v3/users/a55b66a5736440778fecc90366ce523d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:09.870425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.871992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.882803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 898/1806] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:09 2022] PUT /identity/v3/projects/5ffd27a014f34cfdbe95fb15b287da64/users/2cf7fc34ce524052aafba9ce57dc6b89/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:09.884981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:09.890079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:09.995891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36576355-cd26-462e-a592-7d073af12b52 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.002876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.004176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.004752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.005259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] PATH_INFO: `/v3/projects/3df3593f955244a3a928a652e5d565a6` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.006612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df3593f955244a3a928a652e5d565a6)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.008057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5dfd-2465-426c-a6f9-b459ae196ce6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.009285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.013251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.013915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.014199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.014461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] PATH_INFO: `/v3/projects/0012a27bae5b41b6999081fa30b37905` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.016005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0012a27bae5b41b6999081fa30b37905)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.017989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.036571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:10.071667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:10.100255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df3593f955244a3a928a652e5d565a6', 'request_id': 'req-5fe3da56-de2b-4ba5-a9c2-380d91faae84'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.104104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0012a27bae5b41b6999081fa30b37905', 'request_id': 'req-3e8ba6d4-56ed-4def-99d9-0b472767ef49'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.108658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df3593f955244a3a928a652e5d565a6', 'request_id': 'req-5fe3da56-de2b-4ba5-a9c2-380d91faae84'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.112564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0012a27bae5b41b6999081fa30b37905', 'request_id': 'req-3e8ba6d4-56ed-4def-99d9-0b472767ef49'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.119228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df3593f955244a3a928a652e5d565a6', 'request_id': 'req-5fe3da56-de2b-4ba5-a9c2-380d91faae84'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.125911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0012a27bae5b41b6999081fa30b37905', 'request_id': 'req-3e8ba6d4-56ed-4def-99d9-0b472767ef49'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.135985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] The token cache is being invalidate because project 3df3593f955244a3a928a652e5d565a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:10.136312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.137915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5fe3da56-de2b-4ba5-a9c2-380d91faae84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.139473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 899/1807] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:09 2022] DELETE /identity/v3/projects/3df3593f955244a3a928a652e5d565a6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:10.144131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb51a5-698f-4f80-ba8a-37d5368d653d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.144574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb51a5-698f-4f80-ba8a-37d5368d653d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.144861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb51a5-698f-4f80-ba8a-37d5368d653d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.147478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] The token cache is being invalidate because project 0012a27bae5b41b6999081fa30b37905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:10.148035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.149094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8ba6d4-56ed-4def-99d9-0b472767ef49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.154892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 909/1808] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:09 2022] DELETE /identity/v3/projects/0012a27bae5b41b6999081fa30b37905 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:10.156257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.157206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.157567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.170103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-79fb51a5-698f-4f80-ba8a-37d5368d653d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:10.172536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-79fb51a5-698f-4f80-ba8a-37d5368d653d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.184433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:10.184662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.272508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 910/1809] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:10.279331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 900/1810] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:10.281652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.281843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b393-fb39-477e-96be-afc740041d9d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.282197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b393-fb39-477e-96be-afc740041d9d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.282535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659b393-fb39-477e-96be-afc740041d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.283499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.299712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0f7f3-3d57-4b0c-8573-32810263fea3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.305672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.306479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.306858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.307189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] PATH_INFO: `/v3/users/f321d1e56545464c976f602d7d4c4021` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.308513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f321d1e56545464c976f602d7d4c4021)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.310314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e659b393-fb39-477e-96be-afc740041d9d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:10.311489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.312168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e659b393-fb39-477e-96be-afc740041d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.325019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 901/1811] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:10.326347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b393-fb39-477e-96be-afc740041d9d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.329303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e659b393-fb39-477e-96be-afc740041d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.390497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f321d1e56545464c976f602d7d4c4021'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.402352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f321d1e56545464c976f602d7d4c4021'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.422157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f321d1e56545464c976f602d7d4c4021'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.423452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f321d1e56545464c976f602d7d4c4021'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.442913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f321d1e56545464c976f602d7d4c4021'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:10.443920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659b393-fb39-477e-96be-afc740041d9d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.449438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.450090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.450374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.450652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.450892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 911/1812] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:10 2022] DELETE /identity/v3/users/f321d1e56545464c976f602d7d4c4021 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:10.451924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.452874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.453679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.469729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.471448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.488412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 902/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:10.528986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:10.619265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a088-0741-4e37-a8c9-5ee80c731791 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.630393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.631617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.632162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.632874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.655024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:10.655024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.655024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.676532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.683453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:10.685167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 912/1814] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:10.691344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.711367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfcaf0-3703-4d3e-974e-6487d803c41d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.718079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.720185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.720741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.721085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.721910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.724745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.725624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44dbc9-c023-40dd-929e-8a33c4043f2d service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:10.751864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:10.752944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:10.753966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:10.754713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] PATH_INFO: `/v3/projects/ddb197c0872041a9bfd141a66dcd3528` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:10.771534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb197c0872041a9bfd141a66dcd3528)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:10.778946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:10.784234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 913/1815] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:10.788864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:10.993447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.026096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb197c0872041a9bfd141a66dcd3528', 'request_id': 'req-007118de-f74f-43a2-ae1b-157d06976dff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.054249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb197c0872041a9bfd141a66dcd3528', 'request_id': 'req-007118de-f74f-43a2-ae1b-157d06976dff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.055392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33260ec0-76a5-44d2-9478-bec92d774be9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.074218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb197c0872041a9bfd141a66dcd3528', 'request_id': 'req-007118de-f74f-43a2-ae1b-157d06976dff'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.121408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] The token cache is being invalidate because project ddb197c0872041a9bfd141a66dcd3528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:11.122093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.123828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-007118de-f74f-43a2-ae1b-157d06976dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.128872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 903/1816] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:10 2022] DELETE /identity/v3/projects/ddb197c0872041a9bfd141a66dcd3528 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:11.139379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5cff-86a5-4378-976f-7fc0fdfb7f65 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.140050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5cff-86a5-4378-976f-7fc0fdfb7f65 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.140638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5cff-86a5-4378-976f-7fc0fdfb7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.200877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-77af5cff-86a5-4378-976f-7fc0fdfb7f65 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:11.202843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-77af5cff-86a5-4378-976f-7fc0fdfb7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.237503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.239195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.240030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.241878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.243587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.248531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.289252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 914/1817] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:10 2022] POST /identity/v3/users => generated 283 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:11.290757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.294593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.320969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d0fe3-b722-476a-b874-45457768d2e6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.335690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.336585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.337806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.338089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.339194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.346096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.373913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 904/1818] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:11.376421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.377230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.377755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.386193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 915/1819] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:11.392568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.403286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:11.404946 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.417953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 905/1820] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:11.424607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5991bfe-fc07-4cd6-98f1-e6aa10fafed3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.426816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.446017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.446421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719260e-24b6-4a48-b1cf-4dbda79bb0d2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.446946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.447228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.447499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.448163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.449869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.456915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.458188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.458751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.459349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.460809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:11.461437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.464865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.487225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 916/1821] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:11.488181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.496594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 906/1822] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:11.504130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.507238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9fbf7-5487-44dc-a5d2-f568be48aca0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.522599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.523361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.523673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.523965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] PATH_INFO: `/v3/projects/458fda45df4740eebcfd4619249555e3/users/6b767fff794b412eb14938d54ebc6e10/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.530846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e462f16-c466-44fe-86b6-c6bbac912410 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.538134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.539534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.539772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.540042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.540786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.544359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.552448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.560003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] RBAC: Authorizing `identity:create_grant(project_id=458fda45df4740eebcfd4619249555e3, user_id=6b767fff794b412eb14938d54ebc6e10, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.563082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eadea9-3b5c-4ae2-9bb0-df06cb7dadba admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.598775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 917/1823] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:11 2022] PUT /identity/v3/projects/458fda45df4740eebcfd4619249555e3/users/6b767fff794b412eb14938d54ebc6e10/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:11.610470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.610890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.611347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.620009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 907/1824] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:11.624622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.701423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] MFA Rules not processed for user `6b767fff794b412eb14938d54ebc6e10`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:11.703670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.794963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff556eb-5391-4e4b-a7c1-c8dd98b9930e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.805040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.806848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.808208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.810238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.812159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.815993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.845379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 908/1825] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:11.846936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.849074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.866139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae7ce-d00d-4f6b-898a-d53e6b1f09bb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.870895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 918/1826] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:11.872270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.880674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.882235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.882881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.884554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] PATH_INFO: `/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.888629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed1377-9ac2-4a72-ac0e-0531fc2dbdda None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.899719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.900686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b7daabefbd4279ae4b0521bb0b57c8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.900982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.901569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.902653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.903269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.906988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.911290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.933777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 919/1827] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:11.934159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.943940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.956287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce307-dedb-4288-acf9-f2e2bc2865ed admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.966350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.966350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.966350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.966820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.967742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.971935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.026333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 920/1828] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:12.027967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.035956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b7daabefbd4279ae4b0521bb0b57c8', 'request_id': 'req-b63a2023-2e75-4fac-9165-ea2f50e0bd14'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.057607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b7daabefbd4279ae4b0521bb0b57c8', 'request_id': 'req-b63a2023-2e75-4fac-9165-ea2f50e0bd14'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.081167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b7daabefbd4279ae4b0521bb0b57c8', 'request_id': 'req-b63a2023-2e75-4fac-9165-ea2f50e0bd14'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.104210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] The token cache is being invalidate because project b3b7daabefbd4279ae4b0521bb0b57c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:12.105454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.106839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.108475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 909/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:11 2022] DELETE /identity/v3/projects/b3b7daabefbd4279ae4b0521bb0b57c8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:12.112518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.112518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.206027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42eb36-023f-4f7c-87a7-001b8a035e55 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.211941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.212621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.212896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.213304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.213970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.215920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c558-a9cc-4f67-9baa-47309056ec97 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.228744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 921/1830] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:12.233788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.234076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.234590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.242994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2023-2e75-4fac-9165-ea2f50e0bd14 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.254409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.255531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.256034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.256548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.258500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.263289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:12.263561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ad627-5144-4a15-8baa-4080207edbaf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.264822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.288158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 922/1831] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:12.288158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.288158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.306700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea111-596a-42da-b457-4f61230dbf54 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.311112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 910/1832] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:12.313466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.314063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.314521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.314961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.315376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.315497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.315711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] PATH_INFO: `/v3/projects/c54aac89e118452698a28f3c7eff6b44/users/49f092d369a34e09a255baab9c4e5bc2/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.343542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54aac89e118452698a28f3c7eff6b44, user_id=49f092d369a34e09a255baab9c4e5bc2, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.349285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:12.350924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.351141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.377502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 911/1833] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:12.379468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.379631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 923/1834] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:12 2022] PUT /identity/v3/projects/c54aac89e118452698a28f3c7eff6b44/users/49f092d369a34e09a255baab9c4e5bc2/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:12.381739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.420567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4c6e4-ff82-411d-bc15-a1cdc69adfce None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.435816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:12.510330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec73f95-8a40-46a9-abf1-b1b7f875a9c4 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.520893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.521602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.521946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.522179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.522856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:12.523152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.524928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee948bb-c6af-4a9f-b70b-5743f1e7f11c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.553886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 924/1835] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:12.556777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.558054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.558562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.583531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.584782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.585412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.586094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.587283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.590365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5737f-3d85-41bc-a94d-1fd363594ef8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.622459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 912/1836] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:12.622459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.622459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.622459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.652977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] MFA Rules not processed for user `49f092d369a34e09a255baab9c4e5bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:12.654182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.710925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] MFA Rules not processed for user `2cf7fc34ce524052aafba9ce57dc6b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:12.713243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.721544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:12.887518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 925/1837] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:12.889194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.893130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 913/1838] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:12.895346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.910502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0fb92-6234-4eb9-80df-0a0abc9917fc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.913800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374dc7d-5908-45b3-a6d9-dc6dd420ccd7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.920587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.921390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.921804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.922190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.923037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.923493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.924802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.925302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.925786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] PATH_INFO: `/v3/projects/d9cc7a2b6fa84bf0953df6327e820672/users/10d2a5a134eb43ceb863dd9f81c59a42/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.926211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.951560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc7a2b6fa84bf0953df6327e820672, user_id=10d2a5a134eb43ceb863dd9f81c59a42, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.957511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.982703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 926/1839] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:12.982703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.994144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 914/1840] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:12 2022] PUT /identity/v3/projects/d9cc7a2b6fa84bf0953df6327e820672/users/10d2a5a134eb43ceb863dd9f81c59a42/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:12.995586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.998223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:13.098216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5844a-01a7-46d3-b8aa-640dad79e824 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.106751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.107802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.108263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.108782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.109985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.113734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.121897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943f6d-c3c1-4db5-a975-2269ec633a5a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.127829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.128672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.129045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.129420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.130632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.132259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.159540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:13.180054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 915/1841] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:13.184888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.186637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 927/1842] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:12 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:13.188016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.320534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df38ef-634c-4aba-8124-2d6ffbf22b60 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.321403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956788e-82d6-4067-ae3e-ae02649f4e8c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.328527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.329337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.329495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.329954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.330403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.330531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.331034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.331520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.331666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.332935 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.335110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.336048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.353426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:13.357904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 928/1843] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:13.357904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.371457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b25b60-2bad-4087-b548-c87dc19f3965 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.378133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 916/1844] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:13.384268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.385259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.385533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.386716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.387037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.387155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.390355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.410607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25a11-914e-46b5-9a74-0a63c3645a1d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.419041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.419684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.419971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.420247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.421866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.425580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.432195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 929/1845] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/users => generated 306 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:13.433157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.447506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28b1c-08aa-4546-b150-901198ffb275 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.454130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.454937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.455421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.455632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] PATH_INFO: `/v3/projects/d9cc7a2b6fa84bf0953df6327e820672/users/10d2a5a134eb43ceb863dd9f81c59a42/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.460218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 917/1846] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/users => generated 292 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:13.460218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.461833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc7a2b6fa84bf0953df6327e820672, user_id=10d2a5a134eb43ceb863dd9f81c59a42, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.465435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.473012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cc414-4ce7-44bd-b745-d8f2f828e416 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.482050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 930/1847] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:13 2022] PUT /identity/v3/projects/d9cc7a2b6fa84bf0953df6327e820672/users/10d2a5a134eb43ceb863dd9f81c59a42/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:13.486791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.560378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.561289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.561776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.562255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.563966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.565961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.573005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd5b5-406d-45e7-8bcb-29e21cd42f51 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.577818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 918/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:13.579080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.579234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.579311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.579937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.580136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.580711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.582310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a829b9-1494-40a7-8285-aba0e5a756a9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.594600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 931/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:13.595982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.596369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.596592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.598427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db1dc-30a4-4e30-8e1e-601958653294 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.612529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.612529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.612529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.612529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.613367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.613367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.625057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 919/1850] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:13.626227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.633279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] MFA Rules not processed for user `10d2a5a134eb43ceb863dd9f81c59a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:13.634662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:13.636916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da38a-c1bb-4a55-9b13-75febd566f98 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.643312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.644423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.644945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.645227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.645919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.647827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.663130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 920/1851] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:13.664712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.686937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff472-24c2-460e-82c5-776bb91cfb16 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.695747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.696689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.697102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.697509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] PATH_INFO: `/v3/projects/28c0557de6ea46d79b02f30df4c42fc5/users/391ea10e20be47f2a1e370b665b5711d/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.708293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:13.720551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c0557de6ea46d79b02f30df4c42fc5, user_id=391ea10e20be47f2a1e370b665b5711d, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.723737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.739826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 932/1852] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:13.740568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 921/1853] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:13 2022] PUT /identity/v3/projects/28c0557de6ea46d79b02f30df4c42fc5/users/391ea10e20be47f2a1e370b665b5711d/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:13.740741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.741722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.760212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f476-bc05-4e17-866e-cbda44a08d61 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.836343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ff58-d4a3-407e-aa68-1b16bfab8929 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.838990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.839789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.840281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.840923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] PATH_INFO: `/v3/projects/1b796445ec174156b5c2f8655d25a138/users/8b665b7f1fae45b99c979eed660cd76b/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.843187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:13.845119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:13.845338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:13.846624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] PATH_INFO: `/v3/projects/86b29006a6b247e8a0363ac805e99501/users/bd18cdb5cc294f6f9bf744f4bdba325b/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:13.863929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b29006a6b247e8a0363ac805e99501, user_id=bd18cdb5cc294f6f9bf744f4bdba325b, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.866584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.869900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b796445ec174156b5c2f8655d25a138, user_id=8b665b7f1fae45b99c979eed660cd76b, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:13.873257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:13.886370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 922/1854] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:13 2022] PUT /identity/v3/projects/86b29006a6b247e8a0363ac805e99501/users/bd18cdb5cc294f6f9bf744f4bdba325b/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:13.888050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.890132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 933/1855] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:13 2022] PUT /identity/v3/projects/1b796445ec174156b5c2f8655d25a138/users/8b665b7f1fae45b99c979eed660cd76b/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:13.892196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:13.894876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:13.911003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:13.984523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a72393-cb45-4111-827c-10b4df7ea7e3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:13.986737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077641b6-639d-47db-b39d-3752d982ec84 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.003333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.003333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.003333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.003333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.076471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.077210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.077553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.077831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.078979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.082412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44f81-08d8-4d08-aa4b-c1e378599418 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.091463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.093059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.106590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 934/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:14.107430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.107779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 923/1857] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:14.109563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.110801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.111086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.121061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574c1-2cd7-4da8-8d91-463042cb8f2a service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.127883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.128716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.129076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.129437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.130281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.132087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.149167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 935/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:14.151098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.158886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] MFA Rules not processed for user `bd18cdb5cc294f6f9bf744f4bdba325b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:14.160502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.163278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a61c-1f0a-4786-8868-e83b87db6a18 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.169351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.170388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.170806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.171224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] PATH_INFO: `/v3/projects/28c0557de6ea46d79b02f30df4c42fc5/users/391ea10e20be47f2a1e370b665b5711d/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.173865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c0557de6ea46d79b02f30df4c42fc5, user_id=391ea10e20be47f2a1e370b665b5711d, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.177276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.180148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:14.223399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 936/1859] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:14 2022] PUT /identity/v3/projects/28c0557de6ea46d79b02f30df4c42fc5/users/391ea10e20be47f2a1e370b665b5711d/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:14.225375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.271326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 924/1860] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:14.272459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.289012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14ea3-c9a1-4d30-9b6f-d103d47ca609 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.358499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f272-fab9-4ae6-8da9-63a86f4a6bda admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.362438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:14.367479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.369237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.369532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.369809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] PATH_INFO: `/v3/projects/1b796445ec174156b5c2f8655d25a138/users/8b665b7f1fae45b99c979eed660cd76b/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.372840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b796445ec174156b5c2f8655d25a138, user_id=8b665b7f1fae45b99c979eed660cd76b, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.376655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14836d0-57c0-4ba8-8858-b3607bf4059c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.380988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.382507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.383265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.383852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.388938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.390048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 937/1861] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:14 2022] PUT /identity/v3/projects/1b796445ec174156b5c2f8655d25a138/users/8b665b7f1fae45b99c979eed660cd76b/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:14.391710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.392116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.392436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.487086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] MFA Rules not processed for user `391ea10e20be47f2a1e370b665b5711d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:14.492566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.582673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.584654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.618932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 925/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:14.622722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.654617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071113e-b684-475f-b3a1-da5bdba2b074 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.694476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 938/1863] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:14.710040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.712499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:14.844526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.845963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.846639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.847146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.848233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.850904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.872890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430941e5-12fc-48bc-bb19-ee7dd7685449 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:14.889082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:14.889707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:14.890033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:14.890302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:14.913832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:14.915570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:14.925782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 926/1864] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:14 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:14.927432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:14.928101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 939/1865] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:15.050838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.058626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d939b2a-0716-43f8-b26b-2e817c641e2f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.059643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328824b5-0e27-4c99-b5a0-15dfc12fcd60 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.064243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.065112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.065877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.066261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.067128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.069597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.075295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:15.104556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 927/1866] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:14 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:15.109884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.126313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250bd42-004d-48a1-a70f-50b4c91ec30e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.132005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.132925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.133352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.133737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.134580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.136543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.141237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.142509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.143118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.143750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.151863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 928/1867] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:15.157612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.164310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:15.172242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f304c0-56ed-45bf-97f3-5a0db41c836d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.178394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.179375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.179375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.179648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] PATH_INFO: `/v3/projects/7e837ad4b2d646349e8d6654224445cb/users/b15359db366f411cbcef4f02d0542ed4/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.203625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e837ad4b2d646349e8d6654224445cb, user_id=b15359db366f411cbcef4f02d0542ed4, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.206532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.227709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 929/1868] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:15 2022] PUT /identity/v3/projects/7e837ad4b2d646349e8d6654224445cb/users/b15359db366f411cbcef4f02d0542ed4/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:15.233376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.257277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.258980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.275178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 940/1869] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:15.345726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58a8e-39a7-4381-9cea-a7abe0cf143f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.351456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.352097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.353203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.353203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.353538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.355096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572b52-3dc3-4220-8eb8-4d9ebc37ab2e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.371723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 930/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:15.377722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.396301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a4e8-e115-4c06-b072-7b493ff267fe service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.402122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.403012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.403385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.403793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] PATH_INFO: `/v3/projects/7e837ad4b2d646349e8d6654224445cb/users/b15359db366f411cbcef4f02d0542ed4/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.406321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e837ad4b2d646349e8d6654224445cb, user_id=b15359db366f411cbcef4f02d0542ed4, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.409783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe499ac-40ce-445d-b10d-e0d7d79ae70e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.436767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 941/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:15 2022] PUT /identity/v3/projects/7e837ad4b2d646349e8d6654224445cb/users/b15359db366f411cbcef4f02d0542ed4/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:15.440226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.440801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.441255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.511393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] MFA Rules not processed for user `b15359db366f411cbcef4f02d0542ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:15.511393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:15.602092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68bae-3ef0-40af-8352-f84d5b120b07 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.603198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68bae-3ef0-40af-8352-f84d5b120b07 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.603765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68bae-3ef0-40af-8352-f84d5b120b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.659871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-47a68bae-3ef0-40af-8352-f84d5b120b07 None None] MFA Rules not processed for user `8b665b7f1fae45b99c979eed660cd76b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:15.662865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-47a68bae-3ef0-40af-8352-f84d5b120b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:15.712196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 931/1872] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:15.797847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:15.820688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 942/1873] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:15.862594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.863102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.864347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.900068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4f420-4423-4317-b859-cbf9b2b80c20 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:15.908146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:15.908905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:15.909167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:15.909350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:15.911318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] MFA Rules not processed for user `2cf7fc34ce524052aafba9ce57dc6b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:15.913147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:15.934377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:15.935908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:15.972943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 932/1874] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:16.047403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:16.123288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 943/1875] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:16.124767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:16.127051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:16.145398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:16.284217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:16.302194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b444af-1700-4c51-995a-21aace51c26f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:16.311266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:16.312222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:16.312863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:16.313346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:16.323318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e27536-7908-426f-a4d3-3df6dbb00287 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:16.337423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:16.338520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:16.338989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:16.339396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:16.357563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:16.360215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:16.388806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 933/1876] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:16.445664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:16.447456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797d2c7-f666-4221-a054-7885d2efc8f4 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:16.477692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 944/1877] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:18.116364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:18.319858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7d93b-b15a-4898-a96a-f9a2dba732b4 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:18.328137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:18.328598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.329030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.329129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] PATH_INFO: `/v3/users/6b767fff794b412eb14938d54ebc6e10` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.330476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b767fff794b412eb14938d54ebc6e10)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:18.333861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:18.424017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b767fff794b412eb14938d54ebc6e10'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:18.445469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b767fff794b412eb14938d54ebc6e10'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:18.446327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b767fff794b412eb14938d54ebc6e10'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:18.460615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b767fff794b412eb14938d54ebc6e10'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:18.461791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b767fff794b412eb14938d54ebc6e10'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:18.492566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 934/1878] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:18 2022] DELETE /identity/v3/users/6b767fff794b412eb14938d54ebc6e10 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:18.506673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ec55-5f3f-45c3-9982-fe2cb80ff88e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.507384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ec55-5f3f-45c3-9982-fe2cb80ff88e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.507384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ec55-5f3f-45c3-9982-fe2cb80ff88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.532379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-40d5ec55-5f3f-45c3-9982-fe2cb80ff88e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:18.534278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-40d5ec55-5f3f-45c3-9982-fe2cb80ff88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.680941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 945/1879] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:18.696771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:18.701073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.733984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:18.779057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12c27-ab88-493f-a9f9-ddca67549d07 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.779338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12c27-ab88-493f-a9f9-ddca67549d07 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.779611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12c27-ab88-493f-a9f9-ddca67549d07 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.782045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 946/1880] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:23:18.803433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.804059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.804344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.863107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:18.865087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:18.954663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160e49-d7e2-4fd3-87ce-2ebfe79a0a1c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:18.960376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:18.961037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:18.961318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:18.961591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:18.990357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:18.992217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.020597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 935/1881] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:19.030957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 947/1882] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:19.049250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.051791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.073670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa0412-d30c-47a8-8847-83ac85f0165d service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:19.081380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:19.082348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.082348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.082528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.095251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:19.097579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.124717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 936/1883] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:19.457452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.459651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.481698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c374af-2d17-471e-a8ef-c34990d3a170 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:19.493133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:19.494392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.495047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.495367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] PATH_INFO: `/v3/projects/458fda45df4740eebcfd4619249555e3` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.497129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=458fda45df4740eebcfd4619249555e3)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:19.499381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.518952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:19.541574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.543274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.561738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2087f-db7c-409a-bb5c-472aa2b85d5a service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:19.572603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458fda45df4740eebcfd4619249555e3', 'request_id': 'req-eef5e4d1-0e23-4413-aa89-6da78560f77c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.584977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458fda45df4740eebcfd4619249555e3', 'request_id': 'req-eef5e4d1-0e23-4413-aa89-6da78560f77c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.598884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458fda45df4740eebcfd4619249555e3', 'request_id': 'req-eef5e4d1-0e23-4413-aa89-6da78560f77c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.618129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] The token cache is being invalidate because project 458fda45df4740eebcfd4619249555e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:19.619023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.620591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.622892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 948/1884] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:19 2022] DELETE /identity/v3/projects/458fda45df4740eebcfd4619249555e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:19.627718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.629564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.657046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:19.657948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.658348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.658725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] PATH_INFO: `/v3/users/bd18cdb5cc294f6f9bf744f4bdba325b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.660128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd18cdb5cc294f6f9bf744f4bdba325b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:19.662431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.739637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd18cdb5cc294f6f9bf744f4bdba325b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.749225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e4d1-0e23-4413-aa89-6da78560f77c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:19.754304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:19.755063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.755319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.755910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] PATH_INFO: `/v3/users/10d2a5a134eb43ceb863dd9f81c59a42` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.757040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d2a5a134eb43ceb863dd9f81c59a42)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:19.759015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:19.764741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd18cdb5cc294f6f9bf744f4bdba325b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.766126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd18cdb5cc294f6f9bf744f4bdba325b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.776173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd18cdb5cc294f6f9bf744f4bdba325b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.777044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b14344c2-702e-4179-aa76-d20d0d49b0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd18cdb5cc294f6f9bf744f4bdba325b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.802235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 937/1885] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:19 2022] DELETE /identity/v3/users/bd18cdb5cc294f6f9bf744f4bdba325b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:19.807756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:19.808327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:19.808732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:19.841482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d2a5a134eb43ceb863dd9f81c59a42'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.841733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:19.846113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:19.854304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d2a5a134eb43ceb863dd9f81c59a42'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.862361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:19.875145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d2a5a134eb43ceb863dd9f81c59a42'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.877872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d2a5a134eb43ceb863dd9f81c59a42'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.899319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d2a5a134eb43ceb863dd9f81c59a42'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:19.909222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 949/1886] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:19 2022] DELETE /identity/v3/users/10d2a5a134eb43ceb863dd9f81c59a42 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:19.974850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 938/1887] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:19.984163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:19.990423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.048764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:20.117817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8225c12-80bc-4d2a-a774-b36d741d1333 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:20.122729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:20.123471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.123819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.124252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.247062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:20.248918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:20.265169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 950/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:20.394476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:20.396811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.417760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11507-e207-42d1-8977-7e7a8b5acba6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:20.426744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:20.427565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.427931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.428280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] PATH_INFO: `/v3/users/49f092d369a34e09a255baab9c4e5bc2` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.429961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f092d369a34e09a255baab9c4e5bc2)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:20.433006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:20.451061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:20.452986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.478072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd595-6481-4671-b32e-c0b38091481e service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:20.509980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:20.510689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.510970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.511243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] PATH_INFO: `/v3/projects/d9cc7a2b6fa84bf0953df6327e820672` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.513590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cc7a2b6fa84bf0953df6327e820672)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:20.519079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:20.555778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f092d369a34e09a255baab9c4e5bc2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.600161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f092d369a34e09a255baab9c4e5bc2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.603263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f092d369a34e09a255baab9c4e5bc2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.636005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cc7a2b6fa84bf0953df6327e820672', 'request_id': 'req-696462c0-ddd9-4860-a41e-2f830eb544a2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.641007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f092d369a34e09a255baab9c4e5bc2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.642000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-89575cfe-aa50-40ac-bcf9-dde81b35710a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f092d369a34e09a255baab9c4e5bc2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.646257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cc7a2b6fa84bf0953df6327e820672', 'request_id': 'req-696462c0-ddd9-4860-a41e-2f830eb544a2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.665553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cc7a2b6fa84bf0953df6327e820672', 'request_id': 'req-696462c0-ddd9-4860-a41e-2f830eb544a2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.677433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 939/1889] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:20 2022] DELETE /identity/v3/users/49f092d369a34e09a255baab9c4e5bc2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:20.680774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.681247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.681704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.694613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] The token cache is being invalidate because project d9cc7a2b6fa84bf0953df6327e820672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:20.695805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.697052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-696462c0-ddd9-4860-a41e-2f830eb544a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:20.701372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 951/1890] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:20 2022] DELETE /identity/v3/projects/d9cc7a2b6fa84bf0953df6327e820672 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:20.723129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17cfb-2db0-4d9e-ab8f-567eea7e5580 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:20.724729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17cfb-2db0-4d9e-ab8f-567eea7e5580 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:20.726042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa17cfb-2db0-4d9e-ab8f-567eea7e5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:20.742011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:20.743752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.812516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-bfa17cfb-2db0-4d9e-ab8f-567eea7e5580 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:20.819769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bfa17cfb-2db0-4d9e-ab8f-567eea7e5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:20.976347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 940/1891] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:21.053713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.055253 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.074256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.128885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 952/1892] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:21.134362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.134362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.135284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.166052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:21.206390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:21.208306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.222827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 953/1893] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:21.227890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.228126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdea94-c81b-44a7-aeb8-5449ef649d90 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.242102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.242749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.243026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.243295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.255512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29296cb-a52c-46fc-bf99-a941e0bc23f4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.264744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.266409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.266609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.266892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.267201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.268471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.271587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:21.271997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.275024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.280498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 941/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:21.301453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.304169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.330891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 954/1895] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:21.333763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.350558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772be4b-4084-4ea9-9b58-9daeb826b255 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.359374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86706f-d8c4-4401-87b8-ccd7297e857e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.364519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.365254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.365580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.366632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] PATH_INFO: `/v3/projects/86b29006a6b247e8a0363ac805e99501` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.369354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b29006a6b247e8a0363ac805e99501)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.371496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.374919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.375751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.376183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.376484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.377216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.379787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.464164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 955/1896] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:21 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:21.469274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.570989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b29006a6b247e8a0363ac805e99501', 'request_id': 'req-4085e339-94b1-4afc-906c-342d549a35cd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.599841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b29006a6b247e8a0363ac805e99501', 'request_id': 'req-4085e339-94b1-4afc-906c-342d549a35cd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.614143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b29006a6b247e8a0363ac805e99501', 'request_id': 'req-4085e339-94b1-4afc-906c-342d549a35cd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.650465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] The token cache is being invalidate because project 86b29006a6b247e8a0363ac805e99501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:21.650963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.657296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.666566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 942/1897] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:21 2022] DELETE /identity/v3/projects/86b29006a6b247e8a0363ac805e99501 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:21.671379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.675218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.698500 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3fac-4018-4950-80ee-219d2459a51c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.849303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085e339-94b1-4afc-906c-342d549a35cd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.865349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.866594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.867084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.867498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] PATH_INFO: `/v3/users/b15359db366f411cbcef4f02d0542ed4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.869035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15359db366f411cbcef4f02d0542ed4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.873538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.882686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:21.883319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:21.883845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:21.884298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:21.885163 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:21.888132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:21.942687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 956/1898] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:21 2022] POST /identity/v3/users => generated 297 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:21.943884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:21.952635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:21.980322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15359db366f411cbcef4f02d0542ed4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:21.987152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d982c3-a6f6-4163-b5f0-963bf4d65a56 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:21.995114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:22.000063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:22.003836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.005029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.005667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.006711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.009510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.011627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15359db366f411cbcef4f02d0542ed4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:22.015610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15359db366f411cbcef4f02d0542ed4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:22.028453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 957/1899] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:22.034539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15359db366f411cbcef4f02d0542ed4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:22.035535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15359db366f411cbcef4f02d0542ed4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:22.035790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:22.047341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:22.069189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f44484-5e66-43fb-909c-c4c32b93542e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:22.074566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 943/1900] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:21 2022] DELETE /identity/v3/users/b15359db366f411cbcef4f02d0542ed4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:22.076562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:22.077273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.077553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.078296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.079096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.080810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f9d8-ea87-40d5-ad07-ff8ee33c2d0e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.096433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 958/1901] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:22.101231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:22.248857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ffb35-643a-4a39-8c6d-eec14ffbc8ea admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:22.259740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:22.260454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.260737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.261009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] PATH_INFO: `/v3/projects/611c2aff8b864e1eba0871a24cf07d3b/users/47ce5cada8ad42fb81580b3cef0a27a5/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.281369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=611c2aff8b864e1eba0871a24cf07d3b, user_id=47ce5cada8ad42fb81580b3cef0a27a5, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.284887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.305678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 944/1902] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:22 2022] PUT /identity/v3/projects/611c2aff8b864e1eba0871a24cf07d3b/users/47ce5cada8ad42fb81580b3cef0a27a5/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:22.317323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.318335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.318655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.393528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] MFA Rules not processed for user `47ce5cada8ad42fb81580b3cef0a27a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:22.394827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:22.417451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:22.562274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 959/1903] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:22.568029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:22.715926 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bee3d-96e3-4a08-ab67-40f8e8f6ea1b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:22.722275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:22.723059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.723605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.724270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.725191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.728676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.803548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 945/1904] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:22 2022] POST /identity/v3/projects => generated 393 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:22.808802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:22.825061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2293c-299d-45e5-9924-5fa522eac7f5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:22.927808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:22.928868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:22.930716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:22.931229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:22.932414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:22.935737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:22.966507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 960/1905] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:22 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:22.972177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:22.986804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc62d3-5762-4b62-957b-d6014779a9bc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:22.997521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.000105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.000105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.000105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.001212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.005144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:23.039015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 946/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:23.045242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.062676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774f49-b18a-44aa-aff8-51808a35a332 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:23.068351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.069219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.069599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.069944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] PATH_INFO: `/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414/users/98fe01134e1548f1a4b92644e288abd1/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.089838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b2634bfa6f4c86b344d5fb4260d414, user_id=98fe01134e1548f1a4b92644e288abd1, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.093238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:23.110061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 961/1907] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:23 2022] PUT /identity/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414/users/98fe01134e1548f1a4b92644e288abd1/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:23.117250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.131714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dd0e4-e77f-4965-9698-7a46b915cfbc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:23.217094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:23.308562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.312144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.313900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.314758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.316324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.320636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:23.349821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 947/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:23.354538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.377073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.378865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa171cb-a58c-4cff-a738-95f49306b4b2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:23.381547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:23.384090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.384808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.385077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.385340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] PATH_INFO: `/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414/users/98fe01134e1548f1a4b92644e288abd1/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.387391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b2634bfa6f4c86b344d5fb4260d414, user_id=98fe01134e1548f1a4b92644e288abd1, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.390431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd40f15-6348-4e15-b66f-518f6be0bbc6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:23.410759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b34f4-75e1-4ae0-a851-584d31e691de admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:23.427171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 962/1909] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:23 2022] PUT /identity/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414/users/98fe01134e1548f1a4b92644e288abd1/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:23.439485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.439761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.440057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.521726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] MFA Rules not processed for user `98fe01134e1548f1a4b92644e288abd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:23.528082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:23.566235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.566909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.567214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.567450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] PATH_INFO: `/v3/projects/c54aac89e118452698a28f3c7eff6b44` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.568744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54aac89e118452698a28f3c7eff6b44)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.576671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:23.707577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54aac89e118452698a28f3c7eff6b44', 'request_id': 'req-ddb32035-2987-4b55-9d06-7c6341ec5b76'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:23.718813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54aac89e118452698a28f3c7eff6b44', 'request_id': 'req-ddb32035-2987-4b55-9d06-7c6341ec5b76'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:23.747906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54aac89e118452698a28f3c7eff6b44', 'request_id': 'req-ddb32035-2987-4b55-9d06-7c6341ec5b76'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:23.776835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] The token cache is being invalidate because project c54aac89e118452698a28f3c7eff6b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:23.776835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:23.776835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:23.776835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 948/1910] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:23 2022] DELETE /identity/v3/projects/c54aac89e118452698a28f3c7eff6b44 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:23.789805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.795650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:23.799249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:23.825485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 963/1911] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:23.848939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:23.853175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:23.953488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:23.963044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb32035-2987-4b55-9d06-7c6341ec5b76 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:23.989042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:23.989715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:23.989996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:23.990267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] PATH_INFO: `/v3/users/391ea10e20be47f2a1e370b665b5711d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:23.992798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391ea10e20be47f2a1e370b665b5711d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:23.996771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.022124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273da19b-c833-4419-b34b-1b2308e938f4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.083505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391ea10e20be47f2a1e370b665b5711d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.099782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391ea10e20be47f2a1e370b665b5711d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.100709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391ea10e20be47f2a1e370b665b5711d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.111070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391ea10e20be47f2a1e370b665b5711d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.112506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391ea10e20be47f2a1e370b665b5711d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.148119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 949/1912] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:23 2022] DELETE /identity/v3/users/391ea10e20be47f2a1e370b665b5711d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:24.148119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.148119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.163200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.164383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.165198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.165823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.169398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.286356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.290345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.311027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 964/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:24.321229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacaea-892c-4290-8c2a-9c443f3ae528 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.329267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.330894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.331677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.331789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] PATH_INFO: `/v3/projects/7e837ad4b2d646349e8d6654224445cb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.334035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e837ad4b2d646349e8d6654224445cb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.337734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.392041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.394298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.409747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d41c-98dd-4177-b50a-79e8c06a7ef0 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.419433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e837ad4b2d646349e8d6654224445cb', 'request_id': 'req-2fb10a27-ab2a-45e7-b773-9c0425a53378'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.429751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e837ad4b2d646349e8d6654224445cb', 'request_id': 'req-2fb10a27-ab2a-45e7-b773-9c0425a53378'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.440220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e837ad4b2d646349e8d6654224445cb', 'request_id': 'req-2fb10a27-ab2a-45e7-b773-9c0425a53378'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.459402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] The token cache is being invalidate because project 7e837ad4b2d646349e8d6654224445cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:24.460118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.460862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fb10a27-ab2a-45e7-b773-9c0425a53378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.462848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 950/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:24 2022] DELETE /identity/v3/projects/7e837ad4b2d646349e8d6654224445cb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:24.467735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6622-fad7-4912-bac9-faae2ba8e1f0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.468024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6622-fad7-4912-bac9-faae2ba8e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.468451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6622-fad7-4912-bac9-faae2ba8e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.472681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.473356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.473635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.473908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.476105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.494974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.500061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:24.513441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6ced6622-fad7-4912-bac9-faae2ba8e1f0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:24.516186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6ced6622-fad7-4912-bac9-faae2ba8e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.598573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.601084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.619326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 965/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:24.620336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.622251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.649007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 951/1916] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:24.650637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.651028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.652507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.681218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:24.682676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.721588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 952/1917] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:24.726131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.731190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb1b5-aba2-414c-b1c3-dcb71472ccaf service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.737281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.738513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.738917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.739313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] PATH_INFO: `/v3/projects/28c0557de6ea46d79b02f30df4c42fc5` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.740653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c0557de6ea46d79b02f30df4c42fc5)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.741130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4f478-94f0-4a17-8b08-bde16bdcd4ec None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.742921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.747802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.748837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.749354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.749909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.751286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:24.752364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.754315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.776759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 953/1918] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:23:24.782726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.801447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e738b-63eb-4974-abd0-e8e7e6d671a6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:24.814114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:24.815114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.815637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.816010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.817531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:24.820962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:24.829000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c0557de6ea46d79b02f30df4c42fc5', 'request_id': 'req-8864bca7-94cc-422e-bec6-013d908d99e1'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.838679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c0557de6ea46d79b02f30df4c42fc5', 'request_id': 'req-8864bca7-94cc-422e-bec6-013d908d99e1'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.849976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c0557de6ea46d79b02f30df4c42fc5', 'request_id': 'req-8864bca7-94cc-422e-bec6-013d908d99e1'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.871248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 954/1919] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:24.871478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] The token cache is being invalidate because project 28c0557de6ea46d79b02f30df4c42fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:24.871478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.871478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8864bca7-94cc-422e-bec6-013d908d99e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:24.872108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 966/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:24 2022] DELETE /identity/v3/projects/28c0557de6ea46d79b02f30df4c42fc5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:24.873318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:24.875315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:24.880102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b69d-8d5f-4616-977e-eb51a926983a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:24.880964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b69d-8d5f-4616-977e-eb51a926983a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:24.882443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3b69d-8d5f-4616-977e-eb51a926983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:24.942886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e4e3b69d-8d5f-4616-977e-eb51a926983a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:24.944282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e4e3b69d-8d5f-4616-977e-eb51a926983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.066797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.105881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 967/1921] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:25.117020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa2cf-458b-4d04-8dad-4ad0884daad4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.118122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.118122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.118315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.127857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.129031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.129534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.130340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.131858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.138213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.217248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:25.220044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 955/1922] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:24 2022] POST /identity/v3/users => generated 294 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:25.220167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.221351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.258616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 968/1923] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:25.267255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.270883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461b3a7-ef71-40a6-92fb-69c13095da8d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.302122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.306588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.312964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.313594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.314475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.318970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.336839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c939f-ad3e-400d-892b-2297b959958a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.378213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.384220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 956/1924] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:25.393937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.393937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.396624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.397902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:25.401654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.402561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.411740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.443230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ee972-dd45-43a9-89d8-6c874b1966dd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.464581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.465665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.466034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.466313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.466998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.468848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.491711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 969/1925] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:25.493499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.521755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 957/1926] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:25.528105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.580247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49290e6-b4f1-41dc-b8a9-6b06e4611255 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.620538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.622639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.625237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0b36-3d35-41d7-bbc0-bd75816489a2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:25.625831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.626466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.643425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.666116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:25.667050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.667503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.669475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] PATH_INFO: `/v3/projects/430287a0728c443dbb0063af1cb793e8/users/6752fb95ce5347ce94ee965f99fb4d8f/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.677490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.768867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=430287a0728c443dbb0063af1cb793e8, user_id=6752fb95ce5347ce94ee965f99fb4d8f, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:25.783455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 970/1927] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:25.798862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb95e-d0f2-41c4-b1c3-d00d4e7c8ffc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:25.799196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:25.832891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 958/1928] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:25 2022] PUT /identity/v3/projects/430287a0728c443dbb0063af1cb793e8/users/6752fb95ce5347ce94ee965f99fb4d8f/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:25.852643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317ce-0400-4552-90b2-0b322b854329 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:25.853145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317ce-0400-4552-90b2-0b322b854329 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:25.853620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317ce-0400-4552-90b2-0b322b854329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:25.887196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:25.920612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-622317ce-0400-4552-90b2-0b322b854329 None None] MFA Rules not processed for user `6752fb95ce5347ce94ee965f99fb4d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:25.930485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-622317ce-0400-4552-90b2-0b322b854329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:25.970952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb79dc-7158-478a-802b-38ce5ae41542 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.124666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.125537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.125865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.126139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.128247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.130772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.133326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 959/1929] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:26.141486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622317ce-0400-4552-90b2-0b322b854329 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.157988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 971/1930] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:25 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:26.161613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622317ce-0400-4552-90b2-0b322b854329 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.162551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.166526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.167369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.167762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.167906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.168726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.170925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.178522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1115-1017-4ba9-a825-d8aa94a6eafe admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.184174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.184960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.185365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.185750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.186485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.189276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.207971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 972/1931] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:26.209391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.219808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 960/1932] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:26 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:26.224345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.229776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9db8d1-27e2-4b9c-8d78-7776ba478f4b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.289563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:26.325091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b19a-521d-4f74-acd0-1faad341c4ac admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.333115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.333924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.334422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.335535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.336894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.341388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.395010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.396863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.397148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.397426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.397584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 961/1933] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:26 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:26.400074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.401681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.404544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.438853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccc562-322b-40b3-af21-ecd31ca385c8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.440188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 973/1934] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:26.447817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.460592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.461347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.461630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.461904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.462576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.464242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.482128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40010f9-09a9-47f0-8514-83c857265e4a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.497406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.500521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.500855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.501133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] PATH_INFO: `/v3/projects/041e1986eaa04c55986ad8a90e46657d/users/3ffb00ad02984fe4a4d81614501cdb71/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.533734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 962/1935] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:26.540587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.552711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] RBAC: Authorizing `identity:create_grant(project_id=041e1986eaa04c55986ad8a90e46657d, user_id=3ffb00ad02984fe4a4d81614501cdb71, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.569198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499d5a3-db71-4e0f-bf20-25603e14454b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.572813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dffdf-31a9-419d-9b23-d32f3a22ea3c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.593525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.595046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.595519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.599584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] PATH_INFO: `/v3/projects/f1b3f5912205461689e68e00cb238509/users/2a81748eef76441e962a8a68253e1061/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.629352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 974/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:26 2022] PUT /identity/v3/projects/041e1986eaa04c55986ad8a90e46657d/users/3ffb00ad02984fe4a4d81614501cdb71/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:26.632553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.632835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.633113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.645548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b3f5912205461689e68e00cb238509, user_id=2a81748eef76441e962a8a68253e1061, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.652911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.687175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 963/1937] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:26 2022] PUT /identity/v3/projects/f1b3f5912205461689e68e00cb238509/users/2a81748eef76441e962a8a68253e1061/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:26.693570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.708942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] MFA Rules not processed for user `3ffb00ad02984fe4a4d81614501cdb71`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:26.709402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:26.751833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:26.793105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d910929-92fc-4d9a-abaa-df28509209e2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.798151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 975/1938] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:26.801949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.802662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.802943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.803219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.803883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.805571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.823037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.824752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:26.829615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 964/1939] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:26.830992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:26.843059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f6d5-f775-4628-af71-867bf9d36b2d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.851350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:26.852030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.852361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.852690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] PATH_INFO: `/v3/projects/f1b3f5912205461689e68e00cb238509/users/2a81748eef76441e962a8a68253e1061/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.855156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b3f5912205461689e68e00cb238509, user_id=2a81748eef76441e962a8a68253e1061, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:26.859805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07200-78aa-450c-86fb-d92ec3db4aa3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:26.874682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 965/1940] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:26 2022] PUT /identity/v3/projects/f1b3f5912205461689e68e00cb238509/users/2a81748eef76441e962a8a68253e1061/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:26.894900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:26.895418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:26.895739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:26.947099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332fc1d-bd17-4808-a654-68473345b166 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:26.971490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] MFA Rules not processed for user `2a81748eef76441e962a8a68253e1061`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:26.974243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:27.078857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:27.084579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:27.086971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:27.086971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:27.087448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:27.143740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 966/1941] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:27.241392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:27.243930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:27.265620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 976/1942] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:27.271616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:27.273192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:27.301542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7021f-811f-4542-960c-232cbfd7469a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:27.315000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:27.316527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:27.317015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:27.317994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:27.345107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:27.349096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b13665-7beb-438e-a840-8664f8cd0b9c service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:27.362330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 967/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:28.351746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:28.471244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068edfbd-e07f-4650-9927-eda5c0a6f1a4 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:28.485295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:28.486389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.487330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.487911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] PATH_INFO: `/v3/users/6752fb95ce5347ce94ee965f99fb4d8f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.489609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6752fb95ce5347ce94ee965f99fb4d8f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:28.494124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:28.606173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6752fb95ce5347ce94ee965f99fb4d8f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:28.643741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6752fb95ce5347ce94ee965f99fb4d8f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:28.665713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6752fb95ce5347ce94ee965f99fb4d8f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:28.666649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6752fb95ce5347ce94ee965f99fb4d8f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:28.687512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6752fb95ce5347ce94ee965f99fb4d8f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:28.698621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 977/1944] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:28 2022] DELETE /identity/v3/users/6752fb95ce5347ce94ee965f99fb4d8f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:28.708383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.708909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.710331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.749335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:28.751140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:28.855029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 968/1945] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:28.869976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:28.871992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:28.903349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:28.962647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56c34-dff4-4b2d-b901-8924f7844d5e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:28.967850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:28.968831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:28.969428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:28.969678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:28.987161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:28.988921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:29.008551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 978/1946] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:29.562539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:29.565750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:29.590308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647057c6-abb0-42d9-b47f-3ee137c4ed3a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:29.597707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:29.598429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:29.598813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:29.599036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] PATH_INFO: `/v3/projects/430287a0728c443dbb0063af1cb793e8` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:29.600505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430287a0728c443dbb0063af1cb793e8)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:29.602688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:29.635735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:29.675919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430287a0728c443dbb0063af1cb793e8', 'request_id': 'req-81648a7a-ae19-47a9-b797-68547f7ba2a8'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.688236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430287a0728c443dbb0063af1cb793e8', 'request_id': 'req-81648a7a-ae19-47a9-b797-68547f7ba2a8'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.698236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430287a0728c443dbb0063af1cb793e8', 'request_id': 'req-81648a7a-ae19-47a9-b797-68547f7ba2a8'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.714582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] The token cache is being invalidate because project 430287a0728c443dbb0063af1cb793e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:29.715427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.716070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.718436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 969/1947] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:29 2022] DELETE /identity/v3/projects/430287a0728c443dbb0063af1cb793e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:29.728307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:29.740351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219475f-f892-4728-aaec-fae0492f8234 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:29.852639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:29.853299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:29.853574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:29.853839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] PATH_INFO: `/v3/users/2a81748eef76441e962a8a68253e1061` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:29.856582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a81748eef76441e962a8a68253e1061)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:29.858656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:29.959956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a81748eef76441e962a8a68253e1061'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.972874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a81748eef76441e962a8a68253e1061'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.984461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a81748eef76441e962a8a68253e1061'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:29.986257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a81748eef76441e962a8a68253e1061'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.014798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a81748eef76441e962a8a68253e1061'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.029630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 979/1948] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:29 2022] DELETE /identity/v3/users/2a81748eef76441e962a8a68253e1061 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:30.180268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:30.182523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:30.222930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648a7a-ae19-47a9-b797-68547f7ba2a8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:30.408475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:30.409311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:30.411716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:30.411716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] PATH_INFO: `/v3/users/47ce5cada8ad42fb81580b3cef0a27a5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:30.411716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ce5cada8ad42fb81580b3cef0a27a5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:30.424099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:30.487269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:30.489217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:30.529318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1396c-2aa2-43a9-b1aa-3589771a955f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:30.553347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:30.556473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:30.557238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:30.565744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] PATH_INFO: `/v3/users/3ffb00ad02984fe4a4d81614501cdb71` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:30.569092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffb00ad02984fe4a4d81614501cdb71)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:30.586013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:30.611060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ce5cada8ad42fb81580b3cef0a27a5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.645005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ce5cada8ad42fb81580b3cef0a27a5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.646957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ce5cada8ad42fb81580b3cef0a27a5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.677788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ce5cada8ad42fb81580b3cef0a27a5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.678796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-61631034-ffed-4054-a1c0-6dae7e676675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ce5cada8ad42fb81580b3cef0a27a5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.689697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:30.715953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 970/1949] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:30 2022] DELETE /identity/v3/users/47ce5cada8ad42fb81580b3cef0a27a5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:30.718170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffb00ad02984fe4a4d81614501cdb71'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.722311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:30.722845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:30.723431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:30.742842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffb00ad02984fe4a4d81614501cdb71'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.770293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:30.771751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:30.779546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffb00ad02984fe4a4d81614501cdb71'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.784925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffb00ad02984fe4a4d81614501cdb71'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.811817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:30.826644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c8814ca9-3f7d-4d2b-8839-c709a36385c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffb00ad02984fe4a4d81614501cdb71'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:30.839228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 980/1950] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:30 2022] DELETE /identity/v3/users/3ffb00ad02984fe4a4d81614501cdb71 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:30.844516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:30.846440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:30.846916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:30.864540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 971/1951] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:30.888513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:30.890865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:30.908539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:30.914297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:30.943580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0855293-a81c-4a64-8f8d-94fa165d23b4 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.114227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.115284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.115772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.116254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] PATH_INFO: `/v3/projects/f1b3f5912205461689e68e00cb238509` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.121248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 981/1952] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:31.122086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.123915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.128572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b3f5912205461689e68e00cb238509)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.130836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.216696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b3f5912205461689e68e00cb238509', 'request_id': 'req-e5123072-eb7c-4993-b512-463a241ac9d1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:31.225939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b3f5912205461689e68e00cb238509', 'request_id': 'req-e5123072-eb7c-4993-b512-463a241ac9d1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:31.240033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b3f5912205461689e68e00cb238509', 'request_id': 'req-e5123072-eb7c-4993-b512-463a241ac9d1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:31.251850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29dce-338e-461c-9a76-3d93948701d2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.265233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] The token cache is being invalidate because project f1b3f5912205461689e68e00cb238509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:31.265615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:31.266425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:31.268102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 972/1953] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:30 2022] DELETE /identity/v3/projects/f1b3f5912205461689e68e00cb238509 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:31.272289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.272289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.333560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.334681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.335061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.335519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.338496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.373783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5123072-eb7c-4993-b512-463a241ac9d1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.375823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:31.380631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.381877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.382336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.382620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.385311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.409867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:31.466636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.468786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f2f4c-de44-4412-a816-9d5e2c177439 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.477861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.479942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e8f7-80ec-4a7b-92eb-e4cfda9b320a service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.484369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 982/1954] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:31.487132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.487631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.488112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.495378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 973/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:31.513575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:31.514899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.526886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 983/1956] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:31.536969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.537270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.537543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.563079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:31.564567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:31.581030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.584767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 974/1957] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:31.602291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e33e5-827a-40d5-b909-71be9844536f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.615962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.616934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.617244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.617693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.618648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:31.619027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.621678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.644010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 984/1958] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:31.644858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.660501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877ad16-5bb3-4f0a-a905-b9b9b2d27c07 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.669534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.670740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.671265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.672301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.673985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.677834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.727592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 975/1959] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:31 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:31.734011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.749497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70bd11-dc47-4ea6-87c2-1bbbbad0ab0d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.878904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.879704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.880713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.881060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.882301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.885145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.919510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 985/1960] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:31 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:31.928513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:31.943641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281db2b-364b-4725-9599-cedad5f98213 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:31.958607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:31.962172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:31.963084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:31.963695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:31.965471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:31.968134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:31.995542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 976/1961] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:32.001862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.024265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118527b7-472a-442d-9a0b-3a1d6842976f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.025875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.029960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.030617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.031399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.032006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.032652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.033783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.036136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.064156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 986/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:32.065841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.070054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.099434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffd71c-6bf3-438f-9bac-d72d27eb1190 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.100805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5b26-32ad-4fb6-a4a1-8847cad5733e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.109154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.110296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.110800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.111189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] PATH_INFO: `/v3/projects/041e1986eaa04c55986ad8a90e46657d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.113156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041e1986eaa04c55986ad8a90e46657d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.115503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.144503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.145291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.145657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.145986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] PATH_INFO: `/v3/projects/611c2aff8b864e1eba0871a24cf07d3b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.149282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=611c2aff8b864e1eba0871a24cf07d3b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.151639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.246036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041e1986eaa04c55986ad8a90e46657d', 'request_id': 'req-e1240e99-2db6-4198-a044-107c75fa2543'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.261405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611c2aff8b864e1eba0871a24cf07d3b', 'request_id': 'req-ef574434-a1b8-40b2-838c-d5683f66dbfb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.262131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041e1986eaa04c55986ad8a90e46657d', 'request_id': 'req-e1240e99-2db6-4198-a044-107c75fa2543'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.272863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611c2aff8b864e1eba0871a24cf07d3b', 'request_id': 'req-ef574434-a1b8-40b2-838c-d5683f66dbfb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.275356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041e1986eaa04c55986ad8a90e46657d', 'request_id': 'req-e1240e99-2db6-4198-a044-107c75fa2543'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.287002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611c2aff8b864e1eba0871a24cf07d3b', 'request_id': 'req-ef574434-a1b8-40b2-838c-d5683f66dbfb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.294473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] The token cache is being invalidate because project 041e1986eaa04c55986ad8a90e46657d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:32.294878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.295668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.298178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 987/1963] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:32 2022] DELETE /identity/v3/projects/041e1986eaa04c55986ad8a90e46657d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:32.299126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.305653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.306939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] The token cache is being invalidate because project 611c2aff8b864e1eba0871a24cf07d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:32.307468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.308713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ef574434-a1b8-40b2-838c-d5683f66dbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.312538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 977/1964] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:32 2022] DELETE /identity/v3/projects/611c2aff8b864e1eba0871a24cf07d3b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:32.314054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:32.315658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.316173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.316515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.353242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:32.356855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.427378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1240e99-2db6-4198-a044-107c75fa2543 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.480446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:32.500540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 978/1965] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:32.501720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.503329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.521265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.522206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c4a80-a133-4215-8e59-5669efea0dfc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.522693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.523197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.524420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] PATH_INFO: `/v3/projects/244093f0de5b4e12bfefcab2b9e7b104/users/2d81318227724d9bb9a18a448241734a/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.529492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.529492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.529817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.529889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] PATH_INFO: `/v3/users/98fe01134e1548f1a4b92644e288abd1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.531362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fe01134e1548f1a4b92644e288abd1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.535250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.547668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244093f0de5b4e12bfefcab2b9e7b104, user_id=2d81318227724d9bb9a18a448241734a, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.551255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87daf20-c4ab-49fd-bc91-725926c6ec27 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.576019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 988/1966] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:32 2022] PUT /identity/v3/projects/244093f0de5b4e12bfefcab2b9e7b104/users/2d81318227724d9bb9a18a448241734a/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:32.577814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.578074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.578351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.605708 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:32.606541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.618980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fe01134e1548f1a4b92644e288abd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.643584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fe01134e1548f1a4b92644e288abd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.644747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fe01134e1548f1a4b92644e288abd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.656944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fe01134e1548f1a4b92644e288abd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.657761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4dc36feb-3a2b-4f89-bbb2-7b7fb5b7705e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fe01134e1548f1a4b92644e288abd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:32.678315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 979/1967] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:32 2022] DELETE /identity/v3/users/98fe01134e1548f1a4b92644e288abd1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:32.679966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.680292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.680636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.692211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 989/1968] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:32.697164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.709789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ab92-8fe6-477e-8012-44b029def7cc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.726225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] MFA Rules not processed for user `2d81318227724d9bb9a18a448241734a`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:32.728224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.755457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:32.800308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.801541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.802160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.802504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.803276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:32.803761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.805463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.824761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 990/1969] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:32.827293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.839940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a439e-fb4b-4a9c-bbce-b7be8d5411e8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.846493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.847122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.847764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.848877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.849618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.851376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 980/1970] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:32.851809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.856866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.859523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:32.882667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda717b-a7cf-464a-8c45-298283c2fdd6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:32.889150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:32.889901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:32.890340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:32.891402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:32.892401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:32.894174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 991/1971] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:32.895370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:32.899003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.939257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 981/1972] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:32.943941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:32.999095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:33.000180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56e22-9853-49d1-b9bb-4b1d9e25085d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.044749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedb30f-3cef-4668-9818-12f55c1e3fe1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.056428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.056428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.056428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.056428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.056861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.057897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.087170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 982/1973] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:33.087170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.088124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.088716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.088940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.089094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.089324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.089968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.091923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.104374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774be0-3e59-46bd-9e4e-b66dfb0e9e33 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.112616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.113324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.113608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.113884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] PATH_INFO: `/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.115501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b2634bfa6f4c86b344d5fb4260d414)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.118378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.132345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 992/1974] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:32 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:33.132345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.143742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c9e13-70a9-42cf-a93a-072bcf1fa93a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.149298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.150063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.150341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.150750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.151409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.153164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.166767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 993/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:33.167879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.180240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071d24f-95b7-4813-8ed9-e38b1f49845b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.182276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b2634bfa6f4c86b344d5fb4260d414', 'request_id': 'req-e1e4c2f0-8210-457c-b272-5e3bee90d473'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:33.191679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b2634bfa6f4c86b344d5fb4260d414', 'request_id': 'req-e1e4c2f0-8210-457c-b272-5e3bee90d473'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:33.201605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b2634bfa6f4c86b344d5fb4260d414', 'request_id': 'req-e1e4c2f0-8210-457c-b272-5e3bee90d473'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:33.214543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] The token cache is being invalidate because project a2b2634bfa6f4c86b344d5fb4260d414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:33.214834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:33.216827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:33.218358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:33.220903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 983/1976] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:33 2022] DELETE /identity/v3/projects/a2b2634bfa6f4c86b344d5fb4260d414 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:33.221940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.223414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.271012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.271609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.271926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.272215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.273225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.275252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dec8b8-9805-4b84-8eaf-98fee76c8662 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.293678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 994/1977] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:33.296303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.296303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.296303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.318486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:33.320004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.329194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 995/1978] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:33.330087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.331086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4c2f0-8210-457c-b272-5e3bee90d473 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.337990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.342958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.344922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.345209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.345556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] PATH_INFO: `/v3/projects/da6a974d6b51454c8aeec86c2eb5286d/users/d3cb6573634048928f546c88cd1e2219/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.352612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad0b3a-9737-4a9d-8594-8f1df0e1f51c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.361909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.362605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.362949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.363288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.364127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.366569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed2994-6159-4f0d-8343-22b2ba6f7ba3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.368219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6a974d6b51454c8aeec86c2eb5286d, user_id=d3cb6573634048928f546c88cd1e2219, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.372554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.380446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 996/1979] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:33.380639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.380842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.381202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.395481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 984/1980] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:33 2022] PUT /identity/v3/projects/da6a974d6b51454c8aeec86c2eb5286d/users/d3cb6573634048928f546c88cd1e2219/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:33.397327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.406011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:33.407879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.444434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:33.510059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 997/1981] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:33.511436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.512043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61bb9a-c0b7-4820-9672-e58e4382573d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.517873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.518645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.519106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.519392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] PATH_INFO: `/v3/projects/618a83dfe58d4ecbb8373a8f21a11509/users/02d9d0121bff4af0a283d9fb756b95b9/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.534200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733243a-d29d-4e29-a0d2-08a785c62aae None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.541672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.542640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.543053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.543323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.544007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.546639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.552690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618a83dfe58d4ecbb8373a8f21a11509, user_id=02d9d0121bff4af0a283d9fb756b95b9, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.559882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.566311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 998/1982] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:33.566311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.580102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71755-0d5c-4aa9-9df3-3f66f62457ba admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.592031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 985/1983] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:33 2022] PUT /identity/v3/projects/618a83dfe58d4ecbb8373a8f21a11509/users/02d9d0121bff4af0a283d9fb756b95b9/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:33.593165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.673612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.674533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.674797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.675063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.675837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:33.676019 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.678880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab0b4-38c1-4b15-a52a-384bb99f4e09 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.693992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 999/1984] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:33.698008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650228-a217-4b60-8c53-d99f5bbccab2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.699440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650228-a217-4b60-8c53-d99f5bbccab2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.700503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89650228-a217-4b60-8c53-d99f5bbccab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.728095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d4feb-e8cd-4711-99b7-10591a4bc9e2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.734013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.735914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.736197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.736508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] PATH_INFO: `/v3/projects/da6a974d6b51454c8aeec86c2eb5286d/users/d3cb6573634048928f546c88cd1e2219/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.739664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6a974d6b51454c8aeec86c2eb5286d, user_id=d3cb6573634048928f546c88cd1e2219, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.744673 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-89650228-a217-4b60-8c53-d99f5bbccab2 None None] MFA Rules not processed for user `02d9d0121bff4af0a283d9fb756b95b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:33.745953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-89650228-a217-4b60-8c53-d99f5bbccab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.747106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.764361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 986/1985] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:33 2022] PUT /identity/v3/projects/da6a974d6b51454c8aeec86c2eb5286d/users/d3cb6573634048928f546c88cd1e2219/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:33.769864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.771483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:33.854824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1000/1986] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:33.856645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.856992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.857336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.890802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc95602-1269-415f-86b6-480ad06922a1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:33.897090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] MFA Rules not processed for user `d3cb6573634048928f546c88cd1e2219`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:33.898507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.901196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:33.902511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:33.902797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:33.903257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:33.903910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:33.907446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:33.959323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 987/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/projects => generated 409 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:33.963835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:33.965874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:33.997641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1001/1988] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:33.998849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.018117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a51bd-9e24-4bb2-b50b-9ceea29b989a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.024238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.054516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908eeb-60bd-4b72-a434-fc121d75051c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.058678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.059364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.059763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.060038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.084534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.085167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.085441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.085707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.086382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.088349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.113792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1002/1989] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:33 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:34.115100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.116882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.124126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.126009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.131277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb070a-59a5-441e-88ca-4988eb2fc489 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.135074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.135431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 988/1990] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:34.135798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.136112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.136233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.136310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.149306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9387e3-e675-429a-8fdd-ae6fab0d3d29 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.155483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.156138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.156468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.156863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.157517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.164648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.170827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 989/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:34.171567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.176444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.182781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c157-5a76-4c85-a643-efce65be96ce admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.189382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.190032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.190314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.190589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] PATH_INFO: `/v3/users/02d9d0121bff4af0a283d9fb756b95b9` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.191747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d9d0121bff4af0a283d9fb756b95b9)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.193685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.208828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.210328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.221611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1003/1992] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:34.222446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.233238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c8287-3ca4-4723-aea0-6ce9eadf67e2 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.239485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.240108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.240386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.240681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.241327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.242933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.251067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d9d0121bff4af0a283d9fb756b95b9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:34.266809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d9d0121bff4af0a283d9fb756b95b9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:34.268494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1004/1993] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:34.268645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d9d0121bff4af0a283d9fb756b95b9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:34.271866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.275948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d9d0121bff4af0a283d9fb756b95b9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:34.276677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-b34c1bb0-5822-47ab-8684-b88f9ddf3f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d9d0121bff4af0a283d9fb756b95b9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:34.285045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200b76a-1767-462b-82ce-3c2d227a7325 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.290982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.292143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.292462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.292754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] PATH_INFO: `/v3/projects/0c1898e8582d46b792aa4d9a962d5290/users/b93a76fb06514fc2acf21f8f86b501d9/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.293027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 990/1994] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:34 2022] DELETE /identity/v3/users/02d9d0121bff4af0a283d9fb756b95b9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:34.297844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.298129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.298404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.312442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1898e8582d46b792aa4d9a962d5290, user_id=b93a76fb06514fc2acf21f8f86b501d9, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.316203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ae3fb-4cea-4189-81c6-61173f4ce909 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.321084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:34.322544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.336112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1005/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:34 2022] PUT /identity/v3/projects/0c1898e8582d46b792aa4d9a962d5290/users/b93a76fb06514fc2acf21f8f86b501d9/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:34.348570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.348883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.349150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.391615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] MFA Rules not processed for user `b93a76fb06514fc2acf21f8f86b501d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:34.393086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.396855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.426215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 991/1996] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:34.434227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.435754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.481647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1006/1997] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:34.486585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.489296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:34.505192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f9bd-d96a-4729-a484-7f015d1e620d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.580237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472701e-c82e-427e-a1f2-56acf839824f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.582706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.583606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.583861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.584029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.587671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.588231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.588540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.588807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.589453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.596201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.596537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.598122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.610524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 992/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:34.630711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1007/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:34 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:34.635789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.647036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30fd1c-23ce-4ef9-807d-79d25913ef64 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.723894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.724769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.725039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.725311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.725975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.728313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.755907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 993/2000] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:34 2022] POST /identity/v3/users => generated 311 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:34.758999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.799997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d9637-439a-44a9-a6bf-871d026b1ac9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.818760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.819527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.819672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.819923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.823584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.825653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.838149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:34.851585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1008/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:34.854462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.871495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a74ef-7511-43cb-a78b-1757d7cdc930 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:34.879067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:34.880074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:34.880743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:34.881283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] PATH_INFO: `/v3/projects/374af7e40aa64ed0ac184575a89c992d/users/679d3e95b6ce4c93acab83d4b0934320/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:34.904246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374af7e40aa64ed0ac184575a89c992d, user_id=679d3e95b6ce4c93acab83d4b0934320, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:34.908774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:34.933720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 994/2002] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:34 2022] PUT /identity/v3/projects/374af7e40aa64ed0ac184575a89c992d/users/679d3e95b6ce4c93acab83d4b0934320/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:34.936909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:34.955184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c04f9-0d0f-4fed-94f8-dad32f9ec673 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.093354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.094562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.094867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.095212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.096690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.098669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.113734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1009/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:35.116976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.128443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.133173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66754307-e928-4549-b794-e3cf99e82c61 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.134932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.146984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.149581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.149863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.151537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] PATH_INFO: `/v3/projects/374af7e40aa64ed0ac184575a89c992d/users/679d3e95b6ce4c93acab83d4b0934320/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.155028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374af7e40aa64ed0ac184575a89c992d, user_id=679d3e95b6ce4c93acab83d4b0934320, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.162285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99595b5b-2e8a-4bcd-b57c-4494ec65acb0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.163031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5702-6dfa-4feb-8bbe-686ba41130f2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.172528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.174001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.174001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.174215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] PATH_INFO: `/v3/users/2d81318227724d9bb9a18a448241734a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.175445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d81318227724d9bb9a18a448241734a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.178078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.186386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:35.201202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 995/2004] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:35 2022] PUT /identity/v3/projects/374af7e40aa64ed0ac184575a89c992d/users/679d3e95b6ce4c93acab83d4b0934320/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:35.213579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc4ef-3bed-42b0-a3a4-3615170e1ed3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.214055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc4ef-3bed-42b0-a3a4-3615170e1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.214465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edc4ef-3bed-42b0-a3a4-3615170e1ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.263181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d81318227724d9bb9a18a448241734a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.274323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d81318227724d9bb9a18a448241734a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.275103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-03edc4ef-3bed-42b0-a3a4-3615170e1ed3 None None] MFA Rules not processed for user `679d3e95b6ce4c93acab83d4b0934320`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:35.281120 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-03edc4ef-3bed-42b0-a3a4-3615170e1ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.288763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d81318227724d9bb9a18a448241734a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.289684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d81318227724d9bb9a18a448241734a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.312700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d81318227724d9bb9a18a448241734a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.323858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1010/2005] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:35 2022] DELETE /identity/v3/users/2d81318227724d9bb9a18a448241734a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:35.325198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.328032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.399489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 996/2006] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:35.401764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.402055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.402584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.431729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:35.432996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.439004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3785fe-d801-499f-8763-f39871949a04 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.442083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 997/2007] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:35.442948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.444518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.445911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.447245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.447656 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.447940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] PATH_INFO: `/v3/projects/618a83dfe58d4ecbb8373a8f21a11509` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.449286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] RBAC: Authorizing `identity:delete_project(project_id=618a83dfe58d4ecbb8373a8f21a11509)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.452086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.471604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:35.515385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ae238-9810-4be9-bf66-3fff4f14e856 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.522645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618a83dfe58d4ecbb8373a8f21a11509', 'request_id': 'req-277c3fb0-b05f-4c06-a413-e9734eba645c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.529466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618a83dfe58d4ecbb8373a8f21a11509', 'request_id': 'req-277c3fb0-b05f-4c06-a413-e9734eba645c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.538865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618a83dfe58d4ecbb8373a8f21a11509', 'request_id': 'req-277c3fb0-b05f-4c06-a413-e9734eba645c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.553823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] The token cache is being invalidate because project 618a83dfe58d4ecbb8373a8f21a11509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:35.554299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.555030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:35.556858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1011/2008] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:35 2022] DELETE /identity/v3/projects/618a83dfe58d4ecbb8373a8f21a11509 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:35.557634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.559609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.588146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.588146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.588146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.588146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.590682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.637760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3fb0-b05f-4c06-a413-e9734eba645c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.641875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.642511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.642792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.643065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.644986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.657884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:35.685388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.687151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bdc0f-1c33-4d55-bb4c-683b4a5717a3 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.698562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 998/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:35.700163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1686542-e30c-4245-a4c5-1f7c381fcdaf None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.700910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1686542-e30c-4245-a4c5-1f7c381fcdaf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.700910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1686542-e30c-4245-a4c5-1f7c381fcdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.725511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d1686542-e30c-4245-a4c5-1f7c381fcdaf None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:35.726771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d1686542-e30c-4245-a4c5-1f7c381fcdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.741532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.743920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.748030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 999/2010] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:35.759286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.760110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.760110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.772564 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1012/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:35.785320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:35.785851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:35.794806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1000/2012] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:35.800189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.813880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd00fd-08f3-421d-97b4-f6918c13db05 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.820862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.821799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.822075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.822342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.823072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:35.823373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.826934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.844439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1013/2013] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:35.848473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.860780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069787-3f6b-41ad-8128-b15af78fe3e8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.866635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:35.867301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:35.868908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:35.868908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:35.868908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:35.870483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:35.920158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1001/2014] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:35.924299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:35.940167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962347db-d708-43ef-96cc-b6402c204cc5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:35.997848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:36.003323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.005649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.031002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219311-9644-446f-a52b-7109f325856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.032953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219311-9644-446f-a52b-7109f325856a admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.032953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219311-9644-446f-a52b-7109f325856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.032953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219311-9644-446f-a52b-7109f325856a admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.034510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219311-9644-446f-a52b-7109f325856a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.035485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219311-9644-446f-a52b-7109f325856a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.071466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1014/2015] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:35 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:36.072894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219311-9644-446f-a52b-7109f325856a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.104555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219311-9644-446f-a52b-7109f325856a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.110633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.111408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.111797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.112174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.113432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.115213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.135101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82d699-1b41-41b7-96a1-005e46b018da admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.136507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1015/2016] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:36.142502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.145260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.146087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.146430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.146765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.148684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.166890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c8e5-cc3e-4bc7-9063-52c6d4ea4fe9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.177054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.178118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.179742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.180235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.181151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.185424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.217428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1016/2017] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:36.218614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.224071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.244776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e3c49-2f04-457c-bb8a-ecdece737ec6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.251726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.252481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.252761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.253027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] PATH_INFO: `/v3/projects/244093f0de5b4e12bfefcab2b9e7b104` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.254315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244093f0de5b4e12bfefcab2b9e7b104)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.256261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.277509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.279147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.301019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1002/2018] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:36.303071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.321877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da74eb7-52dc-417e-953e-56fdd91f6f05 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.346599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244093f0de5b4e12bfefcab2b9e7b104', 'request_id': 'req-3442bce5-9dc7-4604-9a5c-013fb0f9af20'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.358722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244093f0de5b4e12bfefcab2b9e7b104', 'request_id': 'req-3442bce5-9dc7-4604-9a5c-013fb0f9af20'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.371444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244093f0de5b4e12bfefcab2b9e7b104', 'request_id': 'req-3442bce5-9dc7-4604-9a5c-013fb0f9af20'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.402617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] The token cache is being invalidate because project 244093f0de5b4e12bfefcab2b9e7b104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:36.404097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.405171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.411989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1017/2019] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:36 2022] DELETE /identity/v3/projects/244093f0de5b4e12bfefcab2b9e7b104 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:36.413666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.416536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.469894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.471142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.472091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.473380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] PATH_INFO: `/v3/projects/200bb771342544a5be2157c8a553d73e/users/f87b4b95703943b39dcb2f729ec2f244/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.479270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:36.516600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=200bb771342544a5be2157c8a553d73e, user_id=f87b4b95703943b39dcb2f729ec2f244, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.521358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648d00-8491-49eb-8cd8-60b3455ac7dc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.560075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1003/2020] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:36 2022] PUT /identity/v3/projects/200bb771342544a5be2157c8a553d73e/users/f87b4b95703943b39dcb2f729ec2f244/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:36.565823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.566445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.566691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.570946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442bce5-9dc7-4604-9a5c-013fb0f9af20 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.605885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:36.607341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.661953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:36.731744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.731744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.732775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.733051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] PATH_INFO: `/v3/users/d3cb6573634048928f546c88cd1e2219` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.734585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cb6573634048928f546c88cd1e2219)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.737717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.756234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1004/2021] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:36.766646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:36.768315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:36.860507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c99c-7bd9-44fa-8337-fe64a12b89b6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:36.864424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:36.865544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:36.866002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:36.866419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:36.874859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cb6573634048928f546c88cd1e2219'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.887592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cb6573634048928f546c88cd1e2219'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.891667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:36.895675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:36.899913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cb6573634048928f546c88cd1e2219'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.901115 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cb6573634048928f546c88cd1e2219'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.921437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-34340e7f-7842-47c1-a1db-b03715a21125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cb6573634048928f546c88cd1e2219'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:36.924635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1005/2022] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:36.934442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1018/2023] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:36 2022] DELETE /identity/v3/users/d3cb6573634048928f546c88cd1e2219 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:37.095357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:37.097216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.118202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff407af-4ba0-43a7-91c9-28f523e8300f service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:37.205990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:37.207180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.207509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.207939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] PATH_INFO: `/v3/users/df9322e60bdc4d0fb2bc7c833549ba55` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.209434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9322e60bdc4d0fb2bc7c833549ba55)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:37.211849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:37.270690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:37.301114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9322e60bdc4d0fb2bc7c833549ba55'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.318319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9322e60bdc4d0fb2bc7c833549ba55'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.319123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9322e60bdc4d0fb2bc7c833549ba55'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.328822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9322e60bdc4d0fb2bc7c833549ba55'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.329913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9322e60bdc4d0fb2bc7c833549ba55'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.348877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1006/2024] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:37 2022] DELETE /identity/v3/users/df9322e60bdc4d0fb2bc7c833549ba55 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:37.353815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.354204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.354523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.381611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:37.382980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.405902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:37.410753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.496570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1019/2025] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:37.509195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:37.511218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.536480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55a629-5eee-456b-bbac-53960bae9140 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:37.544343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:37.545056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.545397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.545605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] PATH_INFO: `/v3/projects/da6a974d6b51454c8aeec86c2eb5286d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.547944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6a974d6b51454c8aeec86c2eb5286d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:37.551961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:37.620168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac41b3-730e-454e-9ef6-96b177f37fd0 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:37.625552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6a974d6b51454c8aeec86c2eb5286d', 'request_id': 'req-bf4dada4-7b59-4747-90a3-b4023e3dd954'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.629705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:37.635398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6a974d6b51454c8aeec86c2eb5286d', 'request_id': 'req-bf4dada4-7b59-4747-90a3-b4023e3dd954'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.650084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6a974d6b51454c8aeec86c2eb5286d', 'request_id': 'req-bf4dada4-7b59-4747-90a3-b4023e3dd954'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.668437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] The token cache is being invalidate because project da6a974d6b51454c8aeec86c2eb5286d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:37.668740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.670115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bf4dada4-7b59-4747-90a3-b4023e3dd954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:37.679908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1007/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:37 2022] DELETE /identity/v3/projects/da6a974d6b51454c8aeec86c2eb5286d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:37.681890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c065bb-4fbf-41e7-a3c9-c3b34de9668d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.682186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c065bb-4fbf-41e7-a3c9-c3b34de9668d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.682469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c065bb-4fbf-41e7-a3c9-c3b34de9668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.715516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:37.715795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-01c065bb-4fbf-41e7-a3c9-c3b34de9668d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:37.716351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.716766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.717193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.717827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-01c065bb-4fbf-41e7-a3c9-c3b34de9668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.720222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:37.808661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:37.888076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:37.889901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd701-c1f0-41bf-9b16-4999753832f3 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:37.906018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1008/2027] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:37.907711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.910495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.913191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.915316 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1020/2028] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:37.916713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:37.917008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:37.917284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:37.971831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:37.983713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.022741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] MFA Rules not processed for user `f87b4b95703943b39dcb2f729ec2f244`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:38.023357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1021/2029] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:38.026672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.028013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.074542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef8149-2ae4-4929-a882-40a4334f9539 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.080161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.080760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.081044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.081315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.082595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:38.082913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.085327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.112880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1022/2030] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:38.118577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.165430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b937f4-f978-494b-82e6-f7f750471854 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.181704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.184062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.184349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.184645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.186809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.192734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.301549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1023/2031] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:38 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:38.307999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1009/2032] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:38.315510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.408979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.411105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.429754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa1bd-988a-43a1-86b6-b36ac8f865ae admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.437788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.438769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.439285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.439620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.440355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.443219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.479888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1024/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:38 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:38.482408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.492279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e4cb8-63fe-4e2a-b252-c9e66997b968 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.495095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200bd0e-3af1-4cea-9591-4841cb545e65 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.504791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.505422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.505696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.505972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.506641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.508525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.510598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.525198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1025/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:38.526391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.530838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.549029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7e57-092f-4538-9e3e-ae492aff4d00 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.555815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.556773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.556885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.557094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] PATH_INFO: `/v3/projects/84756c508e664475b8cee3b0a00123c9` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.559369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=84756c508e664475b8cee3b0a00123c9)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.561161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.572036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.573297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.573686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.574121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.630152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:38.631006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84756c508e664475b8cee3b0a00123c9', 'request_id': 'req-516a515c-16ff-4f3b-accf-fbe497a05eda'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.639109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84756c508e664475b8cee3b0a00123c9', 'request_id': 'req-516a515c-16ff-4f3b-accf-fbe497a05eda'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.650195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84756c508e664475b8cee3b0a00123c9', 'request_id': 'req-516a515c-16ff-4f3b-accf-fbe497a05eda'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.654156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.656228 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.667464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1010/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:38.667930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] The token cache is being invalidate because project 84756c508e664475b8cee3b0a00123c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:38.668229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.668355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.669114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.670808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1026/2036] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:38 2022] DELETE /identity/v3/projects/84756c508e664475b8cee3b0a00123c9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:38.674789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.676415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.685918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e012-7f2a-4694-8994-b72fe02ba132 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.766893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.768017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.768537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.768981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.769839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.771703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.784499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a515c-16ff-4f3b-accf-fbe497a05eda admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.786296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1011/2037] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:38.789573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.790311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.790472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.790745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] PATH_INFO: `/v3/users/7cfc7b4ae0c14bb8b8600b7bf6922694` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.791534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:38.791894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfc7b4ae0c14bb8b8600b7bf6922694)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.793869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.794001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.814698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423163f-9f97-4454-ac41-2a495567a8fb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:38.821290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:38.821484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.821800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.822143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] PATH_INFO: `/v3/projects/8e073286408b4ce59dc1f4730c52a3ca/users/07c1e818cebe41b5a874b661c07dd88c/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.842810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e073286408b4ce59dc1f4730c52a3ca, user_id=07c1e818cebe41b5a874b661c07dd88c, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:38.844587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3116-3977-4ec2-b956-ec3cf0e4ecd9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:38.864037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1012/2038] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:38 2022] PUT /identity/v3/projects/8e073286408b4ce59dc1f4730c52a3ca/users/07c1e818cebe41b5a874b661c07dd88c/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:38.875030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:38.877465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:38.879691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:38.932168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] MFA Rules not processed for user `07c1e818cebe41b5a874b661c07dd88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:38.934405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:38.948443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfc7b4ae0c14bb8b8600b7bf6922694'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.984042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfc7b4ae0c14bb8b8600b7bf6922694'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.997338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfc7b4ae0c14bb8b8600b7bf6922694'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:38.998037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfc7b4ae0c14bb8b8600b7bf6922694'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.020366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfc7b4ae0c14bb8b8600b7bf6922694'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.022276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:39.055339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1027/2039] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:38 2022] DELETE /identity/v3/users/7cfc7b4ae0c14bb8b8600b7bf6922694 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:39.083418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1013/2040] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:39.128769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:39.130936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:39.281949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c933d35-14b8-49d6-b271-3b6961708c1e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:39.289613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:39.290390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:39.290721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:39.290992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:39.374978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:39.377369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e342a-7022-4335-a640-8a4ee77c3d88 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:39.392066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1028/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:39.410420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:39.411917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:39.507608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:39.572330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa909-02bb-4718-b1ab-dad47a82ec06 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:39.716750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:39.720525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:39.721019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:39.721469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] PATH_INFO: `/v3/users/07c1e818cebe41b5a874b661c07dd88c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:39.722949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c1e818cebe41b5a874b661c07dd88c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:39.730685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:39.821941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c1e818cebe41b5a874b661c07dd88c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.841901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c1e818cebe41b5a874b661c07dd88c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.844024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c1e818cebe41b5a874b661c07dd88c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.870802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c1e818cebe41b5a874b661c07dd88c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.876457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c1e818cebe41b5a874b661c07dd88c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:39.903625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1014/2042] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:39 2022] DELETE /identity/v3/users/07c1e818cebe41b5a874b661c07dd88c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:39.905166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:39.905698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:39.905856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:39.940182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:39.941550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.039013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1029/2043] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:40.055261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.056945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.065424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.066944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.084325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd606d5c-5a7d-471d-bb56-738a03fb79a3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.090702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.091396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.091622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.092010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] PATH_INFO: `/v3/projects/c2672778fb8945acb7d8fcce76c13ca7` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.094062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2672778fb8945acb7d8fcce76c13ca7)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.096309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.185048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52a0a5-12ca-4ec0-ad73-35dbcc8a9f03 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.202139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:40.205668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2672778fb8945acb7d8fcce76c13ca7', 'request_id': 'req-736a7613-cb08-4569-a570-5f50150500a3'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.213537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2672778fb8945acb7d8fcce76c13ca7', 'request_id': 'req-736a7613-cb08-4569-a570-5f50150500a3'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.216510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:40.223395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2672778fb8945acb7d8fcce76c13ca7', 'request_id': 'req-736a7613-cb08-4569-a570-5f50150500a3'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.235848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] The token cache is being invalidate because project c2672778fb8945acb7d8fcce76c13ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:40.236135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.237336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-736a7613-cb08-4569-a570-5f50150500a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.239221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1030/2044] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:40 2022] DELETE /identity/v3/projects/c2672778fb8945acb7d8fcce76c13ca7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:40.244236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c968f-a1ef-4218-9154-606b9054ffa9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.245179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c968f-a1ef-4218-9154-606b9054ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.245535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c968f-a1ef-4218-9154-606b9054ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.266328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.267242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.267242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.267451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.269629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.272154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d11c968f-a1ef-4218-9154-606b9054ffa9 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:40.273456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d11c968f-a1ef-4218-9154-606b9054ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.365687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.370909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16497c4-1c01-43b0-b145-75cf858a51cf service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.379046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1031/2045] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:40.379046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.379046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.379046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.381451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1015/2046] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:40.382849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.383157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.383421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.406055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] MFA Rules not processed for user `f87b4b95703943b39dcb2f729ec2f244`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:40.406444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:40.407319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.407852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.420073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1016/2047] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:40.421469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.430725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe82f-52c5-4b31-b665-782c9be47288 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.444416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.445351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.447306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.448246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.449341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:40.449941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.452269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.470280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1017/2048] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:23:40.475973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.489975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ea2c0-7e95-40ad-9076-b0baf846137f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.495268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1032/2049] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:40.500380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.501801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.502170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.502546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.503341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.505737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.552016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1018/2050] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:40.556441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.571059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846c60-6c4d-47ec-aff3-9238b3034d00 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.644937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.645552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.645823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.646283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.647626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.650701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.689105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1033/2051] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:40.694393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.726115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d317c-357a-4703-894e-f2d98f9d34d2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.738895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.739569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.739845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.740116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.743877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.746826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.783340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1019/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:40.783760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.803845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56d3d-bf04-445f-9911-d117f76cfd80 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.820674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.821988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.822314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.822574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.823236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.825032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.831619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.833139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:40.833494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:40.841451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1034/2053] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:40.853622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:40.858475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75039c6-b1fd-4554-abf0-463fbfe09f34 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.865666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.866210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.866491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.866766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] PATH_INFO: `/v3/projects/8e073286408b4ce59dc1f4730c52a3ca` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.869364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e073286408b4ce59dc1f4730c52a3ca)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.871530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.874173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584b820-cb8b-4e9c-9d4a-f2d1df9f498c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:40.881486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:40.882414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.883428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.883865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] PATH_INFO: `/v3/projects/291c8ce9cdfd445cb88d85785ebc76d5/users/678c3119e6164c1ba878cfc070d2d086/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.911536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] RBAC: Authorizing `identity:create_grant(project_id=291c8ce9cdfd445cb88d85785ebc76d5, user_id=678c3119e6164c1ba878cfc070d2d086, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:40.915767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b60c54-82c4-423e-a967-08ef7c37401d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:40.936191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1035/2054] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:40 2022] PUT /identity/v3/projects/291c8ce9cdfd445cb88d85785ebc76d5/users/678c3119e6164c1ba878cfc070d2d086/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:40.948948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:40.949165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:40.949429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:40.951656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e073286408b4ce59dc1f4730c52a3ca', 'request_id': 'req-64c260df-c093-49ce-b964-5ca7cf856529'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.962774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e073286408b4ce59dc1f4730c52a3ca', 'request_id': 'req-64c260df-c093-49ce-b964-5ca7cf856529'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.973935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e073286408b4ce59dc1f4730c52a3ca', 'request_id': 'req-64c260df-c093-49ce-b964-5ca7cf856529'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.992497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] The token cache is being invalidate because project 8e073286408b4ce59dc1f4730c52a3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:40.993399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.994244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-64c260df-c093-49ce-b964-5ca7cf856529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:40.995997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1020/2055] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:40 2022] DELETE /identity/v3/projects/8e073286408b4ce59dc1f4730c52a3ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:40.996137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] MFA Rules not processed for user `678c3119e6164c1ba878cfc070d2d086`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:40.997664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:41.003575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312f56-ed06-4203-9cda-29db5ae0bdaa None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.003856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312f56-ed06-4203-9cda-29db5ae0bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.004869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312f56-ed06-4203-9cda-29db5ae0bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.020827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:41.040139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-08312f56-ed06-4203-9cda-29db5ae0bdaa None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:41.041089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-08312f56-ed06-4203-9cda-29db5ae0bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:41.100777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1036/2056] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:41.101810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.103379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:41.132382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1021/2057] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:41.135310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.135639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.136198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.164051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:41.165970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:41.179507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1022/2058] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:41.180551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.193121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63bbc-9030-434e-9d1b-ca60e04e74dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.199764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.200763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.200874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.201155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.201885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:41.202255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.215233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.216585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5219-836f-4cde-810d-21e7ab84c0d8 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.223102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.223867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.224133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.224427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.225081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.227004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.240435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1023/2059] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:41.241675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.259815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2770b6-b891-4547-ae02-8ff588a23489 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.272709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.273550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.279034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1037/2060] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:41.279310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.279310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.279310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.280915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.282141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.357142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1024/2061] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:41.372264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.423285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:41.471273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b35582-fb32-4592-9eb8-766db53462d7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.472067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f527a2-44a4-4d07-a8d4-58810ed2b9c8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.476886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.477499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.477780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.478051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.478483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.478690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.479179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.479369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.479646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.480332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.480739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.482356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.511199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1038/2062] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:41.511338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1025/2063] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:41.512426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.513928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.525383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2b465-18a4-4794-a34c-ac73c5f33917 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.531059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444c43-d22a-4ec6-8f2d-ce5004914722 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.531962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.532627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.533018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.533437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.534245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.535961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.536682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.537304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.537583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.537853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.538510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.540570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.560436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1026/2064] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:41.560709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1039/2065] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:41.564786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.565620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.579414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d28511-ac15-4296-b751-012b45606b2d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.586716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6a4f2-fd28-4b09-ae0e-f5ee68f30e43 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.587950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.589067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.589487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.589913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] PATH_INFO: `/v3/projects/2a53760267694a9ba3c14230706f36d5/users/7580a6a42b724088afe7e57643776c8c/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.613027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.613452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.613670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.613931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.614580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.614729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a53760267694a9ba3c14230706f36d5, user_id=7580a6a42b724088afe7e57643776c8c, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.617038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.617588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.636127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1027/2066] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:41.637807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.650440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76138e5-cea4-4d31-a718-2317f89ce6f4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.659754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1040/2067] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:41 2022] PUT /identity/v3/projects/2a53760267694a9ba3c14230706f36d5/users/7580a6a42b724088afe7e57643776c8c/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:41.664931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.691483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:41.760687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.761375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.761655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.761931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] PATH_INFO: `/v3/projects/5999101adfa64d06af597bdff162407e/users/c8b36f1e330a44beaa1b57087088ae30/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.783860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5999101adfa64d06af597bdff162407e, user_id=c8b36f1e330a44beaa1b57087088ae30, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.787125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3fc5b-4235-419d-a3cf-45d160e5f686 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.787298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932c9d-6d7b-4e38-946d-3f66dbb2a542 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.792347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.793005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.793252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.793521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.794166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.803368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.816545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1041/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:41.820867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1028/2069] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:41 2022] PUT /identity/v3/projects/5999101adfa64d06af597bdff162407e/users/c8b36f1e330a44beaa1b57087088ae30/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:41.822934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.833795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.834984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.835533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.836450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447aeed-ae4f-4763-97d7-274390f925ce admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.874922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] MFA Rules not processed for user `c8b36f1e330a44beaa1b57087088ae30`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:41.876680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:41.918391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:41.919583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.920060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.920585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] PATH_INFO: `/v3/projects/2a53760267694a9ba3c14230706f36d5/users/7580a6a42b724088afe7e57643776c8c/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.924263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a53760267694a9ba3c14230706f36d5, user_id=7580a6a42b724088afe7e57643776c8c, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:41.929868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51814ce-68a1-4b4a-8f2d-2829dd4e171f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:41.943887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1042/2070] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:41 2022] PUT /identity/v3/projects/2a53760267694a9ba3c14230706f36d5/users/7580a6a42b724088afe7e57643776c8c/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:41.956119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:41.956961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:41.957241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:41.965927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1029/2071] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:41.966710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:41.980320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddeeed-6d9b-4581-82e7-d59fcf63c490 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:41.998043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] MFA Rules not processed for user `7580a6a42b724088afe7e57643776c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:41.999352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:42.026202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:42.043261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.044000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.044268 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.044588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.045202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.048530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.079273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1030/2072] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:42.083408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.084293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1043/2073] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:42.096920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.098313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:42.118028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:42.157855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6173e6-a80d-447c-a0ad-8c943ceb2a46 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.162798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.163414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.163699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.164119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.164794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.166035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21b3f-5921-4e67-ba6a-fb0b08ec4d85 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.166714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.195824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1031/2074] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:42 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:42.200194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.212103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c487-7f5a-4657-87e0-fbb4ed9ffd94 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.217141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.217688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.218308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.219184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.219552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.221244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.225185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.225185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.225437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.225622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.232246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1032/2075] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:42.237252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.247590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6660-e888-42d3-8193-d6fc60d907bf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.252918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.253501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.253779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.254047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.254694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.256295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.270263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1033/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:42.271653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.284297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca3c2-c2f4-410d-9f23-0ee2f9c0f461 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.290301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.290985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.291267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.291544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] PATH_INFO: `/v3/projects/81315e29f5324dc089bc316324e6119b/users/6b8a1b3be1404ee8ae19483348cfc091/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.298427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.299960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594b44-b0b6-44ea-84b2-cb80093439db service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.309397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=81315e29f5324dc089bc316324e6119b, user_id=6b8a1b3be1404ee8ae19483348cfc091, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.311213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1044/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:42.312601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.339561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1034/2078] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:42 2022] PUT /identity/v3/projects/81315e29f5324dc089bc316324e6119b/users/6b8a1b3be1404ee8ae19483348cfc091/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:42.352065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.352494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.352835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.393579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] MFA Rules not processed for user `6b8a1b3be1404ee8ae19483348cfc091`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:42.394931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:42.410314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.419926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:42.479588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1fb9-762c-47d1-beac-67c45da866ec admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.487753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.488641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.488906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.489296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.507884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1045/2079] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:42.509975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.583102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.584623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.602707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1035/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:42.693053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184c74-eec9-48db-9e59-c71d47080be3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.705814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.706849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.707374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.708042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.710365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.716775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.772971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1046/2081] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:42 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:42.777564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.798047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294f2fd-927f-4919-8880-7946c1824e65 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.811245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.815567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:42.826699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:42.891661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.893058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.893538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.893919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.895103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.898640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.939403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1036/2082] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:42 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:42.943482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:42.954926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced92872-5a7e-496c-9385-b16661783ae8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.959731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.960451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.960731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.961535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] PATH_INFO: `/v3/users/b93a76fb06514fc2acf21f8f86b501d9` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.962593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93a76fb06514fc2acf21f8f86b501d9)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.964705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.966015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2e66-757f-4dee-a429-8473c71651df admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:42.974386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:42.975806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:42.975806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:42.976232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:42.977319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:42.978862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:42.996607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1037/2083] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:42.997702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.011959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f8159-ebeb-4848-9e57-651856dc13ee admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.018060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.018961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.019435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.019627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] PATH_INFO: `/v3/projects/f985905453054b18a8fa4c93b17ae4db/users/d9dbbc177cbc46f996695c71fca7ab66/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.034672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:43.036842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93a76fb06514fc2acf21f8f86b501d9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.038936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f985905453054b18a8fa4c93b17ae4db, user_id=d9dbbc177cbc46f996695c71fca7ab66, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.041540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.049994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93a76fb06514fc2acf21f8f86b501d9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.060456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1038/2084] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:42 2022] PUT /identity/v3/projects/f985905453054b18a8fa4c93b17ae4db/users/d9dbbc177cbc46f996695c71fca7ab66/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:43.063666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.066775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93a76fb06514fc2acf21f8f86b501d9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.067610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93a76fb06514fc2acf21f8f86b501d9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.085275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e754f32f-e463-485b-9791-f6cf20219dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93a76fb06514fc2acf21f8f86b501d9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.092998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1047/2085] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:42 2022] DELETE /identity/v3/users/b93a76fb06514fc2acf21f8f86b501d9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:43.098674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.098970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.099242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.121669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:43.122972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.158204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679255-c15c-45e8-b5b7-470b77451878 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.220309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1048/2086] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:43.228154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.229692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.249073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.250656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.250850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.251124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.251783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.253445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.264051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1039/2087] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:43.269128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.270882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.284117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296856-91e1-4dab-80dc-99fa1686e29a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.288872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.289544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.289821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.290095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] PATH_INFO: `/v3/projects/f985905453054b18a8fa4c93b17ae4db/users/d9dbbc177cbc46f996695c71fca7ab66/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.292012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f985905453054b18a8fa4c93b17ae4db, user_id=d9dbbc177cbc46f996695c71fca7ab66, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.294701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfe68f-b952-4c4b-a3fd-3d4093fc44d7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.297826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac44e76-479c-4df8-95c1-5aec0a3bcbaf None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.301812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.302419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.302696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.302971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.305430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1040/2088] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:43 2022] PUT /identity/v3/projects/f985905453054b18a8fa4c93b17ae4db/users/d9dbbc177cbc46f996695c71fca7ab66/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:43.316540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.317584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.317868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.318141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.318789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.334750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1049/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:43.342121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:43.355399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] MFA Rules not processed for user `d9dbbc177cbc46f996695c71fca7ab66`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:43.357580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.436863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1041/2090] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:43.451690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.453712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.533403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63e557-889a-404f-8cf7-c6cd13dab8e0 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.552721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:43.613131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.613739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.614008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.614467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.616055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.689449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:43.690495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:43.721282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.723160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.737872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1050/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:43.831537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf8a0-9aaf-4fc0-8a5a-f5db504b8147 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:43.837550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:43.838279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:43.838561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:43.838864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] PATH_INFO: `/v3/projects/0c1898e8582d46b792aa4d9a962d5290` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:43.840128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1898e8582d46b792aa4d9a962d5290)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:43.842743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:43.926939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1898e8582d46b792aa4d9a962d5290', 'request_id': 'req-c60f8a46-24ad-4560-bc18-924b2ab75aa2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.961237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1898e8582d46b792aa4d9a962d5290', 'request_id': 'req-c60f8a46-24ad-4560-bc18-924b2ab75aa2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:43.980414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1898e8582d46b792aa4d9a962d5290', 'request_id': 'req-c60f8a46-24ad-4560-bc18-924b2ab75aa2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.025394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] The token cache is being invalidate because project 0c1898e8582d46b792aa4d9a962d5290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:44.026160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.027339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.030092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1042/2092] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:43 2022] DELETE /identity/v3/projects/0c1898e8582d46b792aa4d9a962d5290 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:44.034647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:44.051494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee711-1adb-4c5b-98f4-0f07cdb5ffa9 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:44.183448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:44.184866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:44.185349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:44.185813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] PATH_INFO: `/v3/users/679d3e95b6ce4c93acab83d4b0934320` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:44.187567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679d3e95b6ce4c93acab83d4b0934320)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:44.189726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:44.297425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679d3e95b6ce4c93acab83d4b0934320'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.307909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679d3e95b6ce4c93acab83d4b0934320'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.318310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679d3e95b6ce4c93acab83d4b0934320'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.319180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679d3e95b6ce4c93acab83d4b0934320'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.342614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:44.348309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-64aecd58-77cf-4a1b-a49b-9e9a324e3891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679d3e95b6ce4c93acab83d4b0934320'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.370889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1051/2093] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:44 2022] DELETE /identity/v3/users/679d3e95b6ce4c93acab83d4b0934320 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:44.724457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:44.726099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:44.754146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8a46-24ad-4560-bc18-924b2ab75aa2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:44.778281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:44.886052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:44.887460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:44.888882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:44.889396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] PATH_INFO: `/v3/projects/374af7e40aa64ed0ac184575a89c992d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:44.892207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374af7e40aa64ed0ac184575a89c992d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:44.897620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:44.969195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374af7e40aa64ed0ac184575a89c992d', 'request_id': 'req-503ce8eb-ff9b-4022-bb67-f1531976a1c7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.979615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374af7e40aa64ed0ac184575a89c992d', 'request_id': 'req-503ce8eb-ff9b-4022-bb67-f1531976a1c7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:44.990201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374af7e40aa64ed0ac184575a89c992d', 'request_id': 'req-503ce8eb-ff9b-4022-bb67-f1531976a1c7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:45.012485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] The token cache is being invalidate because project 374af7e40aa64ed0ac184575a89c992d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:45.015150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:45.017431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-503ce8eb-ff9b-4022-bb67-f1531976a1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:45.019866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1043/2094] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:44 2022] DELETE /identity/v3/projects/374af7e40aa64ed0ac184575a89c992d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:45.027703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.028322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.028691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.085230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:45.090220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:45.184588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1052/2095] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:45.190027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.190325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.190608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.223371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:45.224686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:45.238071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1044/2096] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:45.239664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.251649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b670d1-f0a5-43f4-ba33-5b4e29746c2c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.257625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.257828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.257914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.258180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.258840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:45.268048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.269802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.283563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1053/2097] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:45.287975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.298592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222d42b-ec37-47b4-af1f-2b93025b9ddf None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.306732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.306732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.306732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.307048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.307589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.309811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.348150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1045/2098] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:45.352833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.363331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899de1-a980-44cf-878e-ee216d8fa174 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.460727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.461359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.461620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.461950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.463079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.468424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.498356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1054/2099] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:23:45.502720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.516017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccac2c-6e3d-46f5-8d1e-a626ff4c6aea admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.521847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.522761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.523042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.523313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.524350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.526083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.543131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1046/2100] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:45.544375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.561368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34291b-a480-4285-8d14-302cc69c2871 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.568386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.569701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.570297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.571243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.572255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.574680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8510af-3289-4f38-86db-997c705f98b4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.594133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1055/2101] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:45.594747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.613906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028528a-4ad8-4802-9d07-fe8d27fd33d4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.620909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.621597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.621882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.622216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] PATH_INFO: `/v3/projects/d4ce4a60b53b4a92baaba8f2e9f9d514/users/ff54069293d340b89412729b64deef56/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.641164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ce4a60b53b4a92baaba8f2e9f9d514, user_id=ff54069293d340b89412729b64deef56, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.652451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.679029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1047/2102] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:45 2022] PUT /identity/v3/projects/d4ce4a60b53b4a92baaba8f2e9f9d514/users/ff54069293d340b89412729b64deef56/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:45.700501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.701049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.701419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.757553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] MFA Rules not processed for user `ff54069293d340b89412729b64deef56`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:45.759102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:45.831871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:45.855816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1056/2103] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:45.867709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:45.869491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:45.935126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1947a-62e5-4d86-aab6-8554536fdbd6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:45.940223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:45.941042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:45.941265 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:45.941706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:45.947047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:45.951380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:45.953976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:45.967214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1048/2104] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:46.638333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:46.642436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:46.655505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3917b-ab4f-4fac-b780-a43b64c60bb9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:46.660344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:46.661186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:46.661584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:46.661898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:46.663940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:46.747863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:46.749524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:46.758024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:46.761102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1057/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:46.768015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4424872-7b98-497a-99c0-25867f463a2a service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:46.771971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:46.772659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:46.772935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:46.773205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:46.775240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:46.852138 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:46.854149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:46.865866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1049/2106] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:47.944158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:47.954334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306d8b8-fdfd-464b-af65-f976bbf2ea79 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:47.959499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:47.960335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:47.960822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:47.961254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:47.963553 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:48.096792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:48.100232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a794ccc-aa6f-427d-b729-bd7fe1087f7a service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:48.123191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1058/2107] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:53.179340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:53.180996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.257432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12416461-7b39-45de-bca7-6d03746bdee3 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:53.262302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:53.263032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.263373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.263711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] PATH_INFO: `/v3/users/678c3119e6164c1ba878cfc070d2d086` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.265329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=678c3119e6164c1ba878cfc070d2d086)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:53.267397 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:53.335656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678c3119e6164c1ba878cfc070d2d086'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.359107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678c3119e6164c1ba878cfc070d2d086'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.360040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678c3119e6164c1ba878cfc070d2d086'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.369032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678c3119e6164c1ba878cfc070d2d086'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.369924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678c3119e6164c1ba878cfc070d2d086'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.392193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1050/2108] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:53 2022] DELETE /identity/v3/users/678c3119e6164c1ba878cfc070d2d086 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:53.396541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.397407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.397816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.430317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:53.432110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.512612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:53.514339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.531640 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:53.535972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1059/2109] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:53.547889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:53.550478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:53.584306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:53.626495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ff9af-8214-41db-97f6-a7f5801a029c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:53.631420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:53.632237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.632683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.633091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.646100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:53.647759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7509d-c864-4d31-a860-51565e79f61d service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:53.683174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1060/2110] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:23:53.692825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ee23-74d8-43f7-ba9f-1276568a8c8a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:53.710447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:53.711198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.711527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.712025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] PATH_INFO: `/v3/users/c8b36f1e330a44beaa1b57087088ae30` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.713569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b36f1e330a44beaa1b57087088ae30)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:53.716501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:53.814584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b36f1e330a44beaa1b57087088ae30'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.832323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b36f1e330a44beaa1b57087088ae30'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.833551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b36f1e330a44beaa1b57087088ae30'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.841938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b36f1e330a44beaa1b57087088ae30'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.843018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b36f1e330a44beaa1b57087088ae30'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:53.860470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1051/2111] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:53 2022] DELETE /identity/v3/users/c8b36f1e330a44beaa1b57087088ae30 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:53.864030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:53.864315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:53.864604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:53.897510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:53.899234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.009792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1061/2112] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:54.016808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.019067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.083237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1ae4-c24b-4776-a02b-0efbc9ce9d7d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.087910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.088738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.089022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.089314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.101840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.103299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.115144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1052/2113] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:54.117771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.119709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.134301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00747f0b-2e8b-4158-be0c-bccdbc1e0e23 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.161076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.162635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.162820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.165225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] PATH_INFO: `/v3/projects/291c8ce9cdfd445cb88d85785ebc76d5` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.167507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291c8ce9cdfd445cb88d85785ebc76d5)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.174271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.262378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291c8ce9cdfd445cb88d85785ebc76d5', 'request_id': 'req-66c4db9a-9911-4e53-902b-6ace1d4c2de6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.270707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291c8ce9cdfd445cb88d85785ebc76d5', 'request_id': 'req-66c4db9a-9911-4e53-902b-6ace1d4c2de6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.286178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291c8ce9cdfd445cb88d85785ebc76d5', 'request_id': 'req-66c4db9a-9911-4e53-902b-6ace1d4c2de6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.329267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] The token cache is being invalidate because project 291c8ce9cdfd445cb88d85785ebc76d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:54.329549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.330298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.332148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1062/2114] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:54 2022] DELETE /identity/v3/projects/291c8ce9cdfd445cb88d85785ebc76d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:54.335955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.350056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e734c-6792-4449-9817-9532a6610dc1 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.410115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.462679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.464601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.464601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.464601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] PATH_INFO: `/v3/users/7580a6a42b724088afe7e57643776c8c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.467426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7580a6a42b724088afe7e57643776c8c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.469541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.486443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.488195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.512730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db9a-9911-4e53-902b-6ace1d4c2de6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.522295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.522897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.523394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.523710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] PATH_INFO: `/v3/projects/5999101adfa64d06af597bdff162407e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.524943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5999101adfa64d06af597bdff162407e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.530707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.576096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7580a6a42b724088afe7e57643776c8c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.592021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7580a6a42b724088afe7e57643776c8c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.593787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7580a6a42b724088afe7e57643776c8c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.602322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7580a6a42b724088afe7e57643776c8c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.603056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7580a6a42b724088afe7e57643776c8c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.604784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.615540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5999101adfa64d06af597bdff162407e', 'request_id': 'req-af3c2162-594e-42db-8cad-2d25835f5ea4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.630208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5999101adfa64d06af597bdff162407e', 'request_id': 'req-af3c2162-594e-42db-8cad-2d25835f5ea4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.633974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1053/2115] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:54 2022] DELETE /identity/v3/users/7580a6a42b724088afe7e57643776c8c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:54.644905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5999101adfa64d06af597bdff162407e', 'request_id': 'req-af3c2162-594e-42db-8cad-2d25835f5ea4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.660294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] The token cache is being invalidate because project 5999101adfa64d06af597bdff162407e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:54.660889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.661822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.666353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1063/2116] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:54 2022] DELETE /identity/v3/projects/5999101adfa64d06af597bdff162407e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:54.667771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:54.669260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:54.774113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d090ce-40a6-4183-91f1-20770513d6a6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:54.781437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:54.782177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:54.782524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:54.782868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] PATH_INFO: `/v3/users/6b8a1b3be1404ee8ae19483348cfc091` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:54.784263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8a1b3be1404ee8ae19483348cfc091)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:54.786797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:54.870907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8a1b3be1404ee8ae19483348cfc091'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.872936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:54.892564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8a1b3be1404ee8ae19483348cfc091'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.893333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8a1b3be1404ee8ae19483348cfc091'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.904310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8a1b3be1404ee8ae19483348cfc091'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.905483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8a1b3be1404ee8ae19483348cfc091'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:54.923589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1054/2117] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:54 2022] DELETE /identity/v3/users/6b8a1b3be1404ee8ae19483348cfc091 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:55.502038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:55.504299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.567754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:55.570323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.644631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c2162-594e-42db-8cad-2d25835f5ea4 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:55.668844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0c24f-138b-4bef-bcdc-a599345f22fa admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:55.680251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:55.681669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.681669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.681669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] PATH_INFO: `/v3/projects/2a53760267694a9ba3c14230706f36d5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.684505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a53760267694a9ba3c14230706f36d5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:55.685857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:55.710383 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:55.711006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.711462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.711730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] PATH_INFO: `/v3/projects/81315e29f5324dc089bc316324e6119b` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.712963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81315e29f5324dc089bc316324e6119b)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:55.714862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:55.750153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a53760267694a9ba3c14230706f36d5', 'request_id': 'req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.757862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a53760267694a9ba3c14230706f36d5', 'request_id': 'req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.773288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81315e29f5324dc089bc316324e6119b', 'request_id': 'req-af363806-8de7-4e99-82d3-5b70721cf09f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.778293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a53760267694a9ba3c14230706f36d5', 'request_id': 'req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.781788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81315e29f5324dc089bc316324e6119b', 'request_id': 'req-af363806-8de7-4e99-82d3-5b70721cf09f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.792834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81315e29f5324dc089bc316324e6119b', 'request_id': 'req-af363806-8de7-4e99-82d3-5b70721cf09f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.796356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] The token cache is being invalidate because project 2a53760267694a9ba3c14230706f36d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:55.796720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.797772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1dfed3-8e0a-4b4e-985a-f8cd479f659b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.799053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1055/2118] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:55 2022] DELETE /identity/v3/projects/2a53760267694a9ba3c14230706f36d5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:55.805653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a4fe-b878-4b35-858f-e699700220b6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.805941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a4fe-b878-4b35-858f-e699700220b6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.806211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1a4fe-b878-4b35-858f-e699700220b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.815312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] The token cache is being invalidate because project 81315e29f5324dc089bc316324e6119b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:55.815745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.818065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:55.821632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1064/2119] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:55 2022] DELETE /identity/v3/projects/81315e29f5324dc089bc316324e6119b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:55.824745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:55.827442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.829645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e4c1a4fe-b878-4b35-858f-e699700220b6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:55.830874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e4c1a4fe-b878-4b35-858f-e699700220b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.840364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:55.902955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:55.912937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363806-8de7-4e99-82d3-5b70721cf09f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:55.919763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:55.920552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.920938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.921855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] PATH_INFO: `/v3/users/d9dbbc177cbc46f996695c71fca7ab66` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.922765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1056/2120] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:55.924234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9dbbc177cbc46f996695c71fca7ab66)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:55.930861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:55.932676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:55.933055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:55.933537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:55.968736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:55.970853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:55.986864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1057/2121] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:55.990784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:55.997891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9dbbc177cbc46f996695c71fca7ab66'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.001344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9966-c5cb-4c11-9668-428556c80d10 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.007695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9dbbc177cbc46f996695c71fca7ab66'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.008596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.009493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.009844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.010493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.010998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:23:56.011382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.013145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.019270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9dbbc177cbc46f996695c71fca7ab66'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.020176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9dbbc177cbc46f996695c71fca7ab66'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.030636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1058/2122] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:23:56.031765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.033919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.038369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9dbbc177cbc46f996695c71fca7ab66'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.056124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1065/2123] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:55 2022] DELETE /identity/v3/users/d9dbbc177cbc46f996695c71fca7ab66 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:56.056849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922ae84-2925-4c93-8efc-2953df183bfe admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.149011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.149844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.150238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.150620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.151375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.153787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.212942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1059/2124] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:56.218863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.240266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba812-c8ee-4af1-8a36-22fae5b5c499 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.374337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.375963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.375963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.376206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.377548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.396814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.445699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1066/2125] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:56.449717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.463872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9741-138f-4abd-9024-64800d7f43b0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.479677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.481515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.485378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.486154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.486529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.486898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.487708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.489803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.514149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1060/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:56.514149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.519539 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ef6da-d421-4af0-9cdd-5c91fb0f9cb9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.527080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee000-9e31-4f99-886c-9e39d09908b0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.529599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.530311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.530583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.530952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] PATH_INFO: `/v3/projects/f985905453054b18a8fa4c93b17ae4db` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.532151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f985905453054b18a8fa4c93b17ae4db)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.533467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.534217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.534432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.534825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.535194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.536102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.538011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.553890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1061/2127] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:23:56.560037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:56.561306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.598282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200c73b-3b58-4430-bdb3-2656bd4c7e30 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:56.612050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:56.612776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.613052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.613336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] PATH_INFO: `/v3/projects/591cb3abbcd1464c821f6e74fdfa7576/users/98aa9804f38f4ab898a43f4b3f73cdf2/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.626938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f985905453054b18a8fa4c93b17ae4db', 'request_id': 'req-74ef3317-5faa-4628-ac77-98f147ca471b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.633442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591cb3abbcd1464c821f6e74fdfa7576, user_id=98aa9804f38f4ab898a43f4b3f73cdf2, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:56.638506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f985905453054b18a8fa4c93b17ae4db', 'request_id': 'req-74ef3317-5faa-4628-ac77-98f147ca471b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.646696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a1ea6-e403-4be4-b225-c8a3dbdfcdd6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:56.650512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f985905453054b18a8fa4c93b17ae4db', 'request_id': 'req-74ef3317-5faa-4628-ac77-98f147ca471b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.667596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1062/2128] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:56 2022] PUT /identity/v3/projects/591cb3abbcd1464c821f6e74fdfa7576/users/98aa9804f38f4ab898a43f4b3f73cdf2/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:56.680270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703619e-d895-4f6d-b302-064448717637 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:56.680883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703619e-d895-4f6d-b302-064448717637 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:56.681423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703619e-d895-4f6d-b302-064448717637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:56.692008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] The token cache is being invalidate because project f985905453054b18a8fa4c93b17ae4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:56.692594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.696550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:56.713837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1067/2129] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:56 2022] DELETE /identity/v3/projects/f985905453054b18a8fa4c93b17ae4db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:56.773585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4703619e-d895-4f6d-b302-064448717637 None None] MFA Rules not processed for user `98aa9804f38f4ab898a43f4b3f73cdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:56.775011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4703619e-d895-4f6d-b302-064448717637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:56.972438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1063/2130] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:56.974890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:56.976974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:57.074053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef3317-5faa-4628-ac77-98f147ca471b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.168554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.169651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.170224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.170872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.172712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.178168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.217370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1068/2131] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:57.222356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703619e-d895-4f6d-b302-064448717637 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.234759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703619e-d895-4f6d-b302-064448717637 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.244951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:57.316760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.317292 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.317573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.317843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.318529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.320993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.357089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1064/2132] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:23:57 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:23:57.362419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.378077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8400ea-d13e-4d82-8883-e9e19983d64e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.405277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.406266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.406512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.406851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.407636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.409425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.436531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1069/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:57.441247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.456143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fff35-0ddf-4512-9291-e386ba113a7e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.461841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.462630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.462962 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.463776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] PATH_INFO: `/v3/projects/07457dc95c004009871fd5756ce7ffb8/users/08165137437642b29039496fcad6684e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.485580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07457dc95c004009871fd5756ce7ffb8, user_id=08165137437642b29039496fcad6684e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.488766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.516141 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1065/2134] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:57 2022] PUT /identity/v3/projects/07457dc95c004009871fd5756ce7ffb8/users/08165137437642b29039496fcad6684e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:57.516895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.537205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafda40e-6356-40cd-b9f1-54526c5c4343 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.572309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:57.660610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.661256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.661652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.661920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.662979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.666611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c15b5-b34a-483a-9fc3-d8d1f0af3d8e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.725938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.727772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1070/2135] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:23:57.740206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726604-7055-40ba-896f-601a242fc31b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:57.755556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:57.757341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.757786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.758192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] PATH_INFO: `/v3/projects/07457dc95c004009871fd5756ce7ffb8/users/08165137437642b29039496fcad6684e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.760300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07457dc95c004009871fd5756ce7ffb8, user_id=08165137437642b29039496fcad6684e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:57.765188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:57.782748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1066/2136] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:23:57 2022] PUT /identity/v3/projects/07457dc95c004009871fd5756ce7ffb8/users/08165137437642b29039496fcad6684e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:57.798436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:57.798719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:57.798990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:57.839635 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] MFA Rules not processed for user `08165137437642b29039496fcad6684e`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:57.841434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:57.980634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1071/2137] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:57.993112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:57.995840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.131527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ce817-9070-43f5-ba9e-46c73f14099b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:58.140053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:58.140925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.141546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.141912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.165480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:58.167726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:58.183493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1067/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:58.756861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:58.790427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:58.791927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:58.882958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27928000-e67e-4b8c-93b3-f3bb5610ee27 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:58.891778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:58.892469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.892752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.893154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] PATH_INFO: `/v3/users/98aa9804f38f4ab898a43f4b3f73cdf2` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.894716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98aa9804f38f4ab898a43f4b3f73cdf2)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:58.898055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:58.909619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9c68e-d712-443e-9be4-09993dd4c8af service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:58.925499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:58.926176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:58.926447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:58.927337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] PATH_INFO: `/v3/users/ff54069293d340b89412729b64deef56` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:58.928741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff54069293d340b89412729b64deef56)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:58.932202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:58.935788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:58.997848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:59.000607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98aa9804f38f4ab898a43f4b3f73cdf2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.019327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98aa9804f38f4ab898a43f4b3f73cdf2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.035200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff54069293d340b89412729b64deef56'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.058552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff54069293d340b89412729b64deef56'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.058925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98aa9804f38f4ab898a43f4b3f73cdf2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.059783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff54069293d340b89412729b64deef56'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.062064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98aa9804f38f4ab898a43f4b3f73cdf2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.071509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff54069293d340b89412729b64deef56'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.072564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e65facbc-aefc-4e04-a93b-ca5347762e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff54069293d340b89412729b64deef56'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.097907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e306d246-9d40-4028-a4c3-114ce54717c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98aa9804f38f4ab898a43f4b3f73cdf2'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.104699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1068/2139] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:58 2022] DELETE /identity/v3/users/ff54069293d340b89412729b64deef56 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:23:59.113139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1072/2140] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:58 2022] DELETE /identity/v3/users/98aa9804f38f4ab898a43f4b3f73cdf2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:59.113767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.114169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.114539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.117436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.117707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.117974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.158184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:59.162549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.162752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:59.163969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.317734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1073/2141] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:59.323045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1069/2142] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:59.367220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:59.367455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:59.368635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.369189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.475856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6dcdb-b353-44eb-996a-8952e43253d6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:59.478432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c40be-297a-49ae-a880-a57ff364e696 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:59.481486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:59.482676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.483429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.483969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.486755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:59.495350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:59.496995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7330a5d-a84c-45db-b022-37e70a77523f service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:59.500447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.501027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.501386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.509247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1070/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:59.536858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:59.538625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f671-e22c-4883-9b63-ea7d8da0ec79 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:59.565869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1074/2144] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:59.626840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.627773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.629438 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.632568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1071/2145] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:23:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:59.640728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b896f-04f3-45c3-afe9-1e30adc5bf09 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.641113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b896f-04f3-45c3-afe9-1e30adc5bf09 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.641452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b896f-04f3-45c3-afe9-1e30adc5bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.705936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5c4b896f-04f3-45c3-afe9-1e30adc5bf09 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:59.709299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5c4b896f-04f3-45c3-afe9-1e30adc5bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.732705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:59.735652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:59.772699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6a3a-277a-4b03-80e4-dd0e1a8795d6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:59.780136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:59.781223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.781688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.782121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] PATH_INFO: `/v3/users/bfacd0a28d2a4dcb90eff48a42f0ffc7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.783734 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfacd0a28d2a4dcb90eff48a42f0ffc7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:59.786091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:59.819634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:59.896716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfacd0a28d2a4dcb90eff48a42f0ffc7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.915266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1075/2146] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:59.935354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298071-fcf1-4483-b736-56d70cde0f81 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.935795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298071-fcf1-4483-b736-56d70cde0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.936298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96298071-fcf1-4483-b736-56d70cde0f81 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.939016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1076/2147] 10.222.0.20 () {54 vars in 961 bytes} [Mon Aug 29 20:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:23:59.946848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfacd0a28d2a4dcb90eff48a42f0ffc7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.947971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfacd0a28d2a4dcb90eff48a42f0ffc7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.950490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:59.950806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:59.952012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:59.966971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfacd0a28d2a4dcb90eff48a42f0ffc7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.968663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:59.968800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfacd0a28d2a4dcb90eff48a42f0ffc7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:59.999989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:00.001818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1072/2148] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:59 2022] DELETE /identity/v3/users/bfacd0a28d2a4dcb90eff48a42f0ffc7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:00.003849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.108739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.110445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.123999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1077/2149] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Aug 29 20:23:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:00.137790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.159560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a150ee-eaf5-431d-be0b-8f7e1106b741 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.165584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.166585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.166957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.167227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.169138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.185109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.187498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.203958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1078/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:00.213738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.219625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.240999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc3c85-ff46-49e3-a084-211d17eb296f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.247230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.247230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.247587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.247776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] PATH_INFO: `/v3/projects/d4ce4a60b53b4a92baaba8f2e9f9d514` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.249561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ce4a60b53b4a92baaba8f2e9f9d514)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.251358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.316385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ce4a60b53b4a92baaba8f2e9f9d514', 'request_id': 'req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.322320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467862-5fb1-4ef1-8dea-e80c42ac2d90 service placement] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.323643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ce4a60b53b4a92baaba8f2e9f9d514', 'request_id': 'req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.335394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ce4a60b53b4a92baaba8f2e9f9d514', 'request_id': 'req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.351508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] The token cache is being invalidate because project d4ce4a60b53b4a92baaba8f2e9f9d514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:00.351831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.352619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.355074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1073/2151] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:00 2022] DELETE /identity/v3/projects/d4ce4a60b53b4a92baaba8f2e9f9d514 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:00.356057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.357819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.393452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.394817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.395095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.395581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] PATH_INFO: `/v3/projects/591cb3abbcd1464c821f6e74fdfa7576` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.397608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591cb3abbcd1464c821f6e74fdfa7576)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.399956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.400128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.439751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7bf0-9b9b-4fab-a0b0-72ea63c42dd6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.446172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.447154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.447294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.447889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] PATH_INFO: `/v3/projects/0ddf6aeb067f4b3182f5684947196e98` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.449250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddf6aeb067f4b3182f5684947196e98)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.450974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.451186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.469432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591cb3abbcd1464c821f6e74fdfa7576', 'request_id': 'req-85aa58cd-6295-4390-ba3a-79c72abbb043'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.476938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591cb3abbcd1464c821f6e74fdfa7576', 'request_id': 'req-85aa58cd-6295-4390-ba3a-79c72abbb043'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.486894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591cb3abbcd1464c821f6e74fdfa7576', 'request_id': 'req-85aa58cd-6295-4390-ba3a-79c72abbb043'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.506791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] The token cache is being invalidate because project 591cb3abbcd1464c821f6e74fdfa7576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:00.507281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.508012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-85aa58cd-6295-4390-ba3a-79c72abbb043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.510695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1079/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:00 2022] DELETE /identity/v3/projects/591cb3abbcd1464c821f6e74fdfa7576 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:00.515545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bab2-0a67-46e6-8032-218fee33fabd None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.516089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bab2-0a67-46e6-8032-218fee33fabd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.516344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03bab2-0a67-46e6-8032-218fee33fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.517772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddf6aeb067f4b3182f5684947196e98', 'request_id': 'req-c9d7d93b-1e37-4a18-a739-a6ad257710f7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.529467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddf6aeb067f4b3182f5684947196e98', 'request_id': 'req-c9d7d93b-1e37-4a18-a739-a6ad257710f7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.538403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8d03bab2-0a67-46e6-8032-218fee33fabd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:00.539215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddf6aeb067f4b3182f5684947196e98', 'request_id': 'req-c9d7d93b-1e37-4a18-a739-a6ad257710f7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.539878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8d03bab2-0a67-46e6-8032-218fee33fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.570335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] The token cache is being invalidate because project 0ddf6aeb067f4b3182f5684947196e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:00.570669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.571202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.572915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1074/2153] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:00 2022] DELETE /identity/v3/projects/0ddf6aeb067f4b3182f5684947196e98 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:00.578331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.579982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.633890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1080/2154] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:00.635386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb2d3-88fe-45f0-bad4-daaff29e23be None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.635672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb2d3-88fe-45f0-bad4-daaff29e23be None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.635977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb2d3-88fe-45f0-bad4-daaff29e23be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.673840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-28cfb2d3-88fe-45f0-bad4-daaff29e23be None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:00.675798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-28cfb2d3-88fe-45f0-bad4-daaff29e23be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.682055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7d93b-1e37-4a18-a739-a6ad257710f7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.689287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1081/2155] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:00.693531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a284e-7f22-4dfd-84f9-7318ab09998d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.694267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a284e-7f22-4dfd-84f9-7318ab09998d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.694417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a284e-7f22-4dfd-84f9-7318ab09998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.697822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.699019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.699378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.699846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] PATH_INFO: `/v3/users/08165137437642b29039496fcad6684e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.704199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08165137437642b29039496fcad6684e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.706336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.719589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-874a284e-7f22-4dfd-84f9-7318ab09998d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:00.720943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-874a284e-7f22-4dfd-84f9-7318ab09998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.729497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1082/2156] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:00.732376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.734069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.734526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.760513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:00.762181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.776549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1083/2157] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:00.777690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.781144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08165137437642b29039496fcad6684e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.790004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:00.792559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ccec9-8b9b-4cf0-bbde-d2894cf16e77 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.795652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08165137437642b29039496fcad6684e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.798966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08165137437642b29039496fcad6684e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.800464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.801113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.801388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.801654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.803938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:00.804060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.809951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.812690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08165137437642b29039496fcad6684e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.813840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08165137437642b29039496fcad6684e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:00.827670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1084/2158] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:00.828577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.830570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.838808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1075/2159] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:00 2022] DELETE /identity/v3/users/08165137437642b29039496fcad6684e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:00.842372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:00.848441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d3ff-1ed5-4fa8-b4a1-d2038eff8dcb admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:00.848675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:00.948371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:00.949268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:00.949555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:00.949828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:00.950587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:00.950898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:00.953742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:00.999788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1085/2160] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:01.009094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.011121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2080539-f77e-4ac2-a34f-bed34d7c4627 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.017288 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.019315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.019597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.019904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.021219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.023346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.026815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd185-8bac-4348-86eb-44a695a9d644 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.038241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.038914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.039195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.039731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.040408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.043475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.099798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1076/2161] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:00 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:01.102210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.102795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1086/2162] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:01.107904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.117943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:01.229075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00dcf-0d58-4329-86ca-24e534e09b32 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.235990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.236788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.237151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.237521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.238222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.239924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810349-e80d-450c-bc8a-b47d7b9811bc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.240720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.247739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.248971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.250757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.251156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.252303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.255019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.271550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1087/2163] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:01.277373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.290780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba8570-63da-4cdd-8a92-1a3b3e4add42 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.298698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.299761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.302519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.303100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.304360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.306657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.306776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1077/2164] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:01.313189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.328702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f1684-3b24-4052-8cfa-ead290598e39 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.334623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.334981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1088/2165] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:01.335607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.335974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.336255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.337095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.338807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.340556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.355375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1078/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:01.356254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559567e-6787-4f8b-9f24-76fd7a8ce972 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.356996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.367390 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.368105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.368401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.368690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.369589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.371970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.378025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c07f3-f745-4754-b208-84e6e90a853b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.389340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.391075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.391075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.391850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.392601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.395401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1089/2167] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:01.395401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.395698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.402329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.417938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1079/2168] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:01.419154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.428170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9fbf-ddbf-48b5-a7ab-21b3b116744d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.437983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.439041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.439447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.439812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebaec-9b5f-4ed6-983f-6f26853a6d24 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.439961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] PATH_INFO: `/v3/projects/07457dc95c004009871fd5756ce7ffb8` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.443015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07457dc95c004009871fd5756ce7ffb8)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.446830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.447713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.448944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.449058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.450415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] PATH_INFO: `/v3/projects/bef6b580b86f4e94bc2aeb8677da8781/users/e7cf1859de244861995386780e46f0cf/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.473217 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef6b580b86f4e94bc2aeb8677da8781, user_id=e7cf1859de244861995386780e46f0cf, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.476245 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.505859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1080/2169] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:01 2022] PUT /identity/v3/projects/bef6b580b86f4e94bc2aeb8677da8781/users/e7cf1859de244861995386780e46f0cf/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:01.506997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.516752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:01.528047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07457dc95c004009871fd5756ce7ffb8', 'request_id': 'req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:01.539073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07457dc95c004009871fd5756ce7ffb8', 'request_id': 'req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:01.549784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07457dc95c004009871fd5756ce7ffb8', 'request_id': 'req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:01.564493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] The token cache is being invalidate because project 07457dc95c004009871fd5756ce7ffb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:01.564493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:01.565181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a6cf9d8c-4a5f-4139-aa16-0fcb19e7eda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:01.570077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1090/2170] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:01 2022] DELETE /identity/v3/projects/07457dc95c004009871fd5756ce7ffb8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:01.570077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e91ba-ea4f-48ad-97a6-b24591872e75 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.570077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e91ba-ea4f-48ad-97a6-b24591872e75 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.570077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e91ba-ea4f-48ad-97a6-b24591872e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.592536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-344e91ba-ea4f-48ad-97a6-b24591872e75 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:01.594362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-344e91ba-ea4f-48ad-97a6-b24591872e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.603915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a10dc4-b7d1-4bbd-a426-e9b763586330 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.676382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:01.697021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1091/2171] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:01.700687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.700687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.700687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.710611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.711674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.712137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.712609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] PATH_INFO: `/v3/projects/2d826dcf541043eaa1ca4204af2093d6/users/5e8bbcb87073485aa05ae5813e0af779/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.730819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:01.733675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.737076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d826dcf541043eaa1ca4204af2093d6, user_id=5e8bbcb87073485aa05ae5813e0af779, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.741576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3edd4e-703b-4706-92da-130252a3f2d1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.744679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1092/2172] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:01.745583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.756071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.774658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1081/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:01 2022] PUT /identity/v3/projects/2d826dcf541043eaa1ca4204af2093d6/users/5e8bbcb87073485aa05ae5813e0af779/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:01.777852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f8ce-b901-4e9f-b683-00b4dc9f3184 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.778370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f8ce-b901-4e9f-b683-00b4dc9f3184 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.778861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f8ce-b901-4e9f-b683-00b4dc9f3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.820940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5069f8ce-b901-4e9f-b683-00b4dc9f3184 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:01.822168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5069f8ce-b901-4e9f-b683-00b4dc9f3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.842603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7bf27-27cb-4f75-ba17-2ab266688d30 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.909977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1082/2174] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:01.911290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.911610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.911857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.922787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.923898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.924461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.924992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.934092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:01.935547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.939485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.941473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.946921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1083/2175] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:01.947883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.962236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1093/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:01.962784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:01.965837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:01.966565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed57ad-9e9a-400b-8b0f-8bfd4dd40cfb None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:01.972785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:01.973517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:01.973860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:01.974197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:01.975605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:01.976013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:01.978053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:01.992920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d29bd6-654f-4978-9ea4-01e5d08eeaa3 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.000456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1084/2177] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:02.000698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.000698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.000698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.000698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.002895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.016108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.018468 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.018863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3a80-a480-4351-a788-ded8ef4ef8e0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.027928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.029143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.029695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.030293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.031520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.035257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.038672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1094/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:02.090102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:02.114371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1085/2179] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:02.116085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.131880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d90e78-5159-4fc4-97f5-c258a2de74e2 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.229869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.230855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.231731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.232176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.232970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.236380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.288219 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1095/2180] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:02.288970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.301244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258992f-7d27-4beb-a7ff-c554061452cf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.307343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.307501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.307847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.308252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.309483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.311347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.326621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1086/2181] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:02.330774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.345573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49460f1-0c84-4208-b7d2-c43307de1176 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.355600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.356606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.357514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.357897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.359903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.361909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165b78c-9fab-4d03-8c99-90fd6f8dabc2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.378014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1096/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:02.382069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.395730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f9b1d-734a-421f-b0bf-231ff0745f42 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.402779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.403801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.404036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.404441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] PATH_INFO: `/v3/projects/fdc86a8208264e42ac099d92c12af63f/users/fc76974c6d524f0c885a0f243ca0ae40/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.427525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc86a8208264e42ac099d92c12af63f, user_id=fc76974c6d524f0c885a0f243ca0ae40, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.433030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.456902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1087/2183] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:02 2022] PUT /identity/v3/projects/fdc86a8208264e42ac099d92c12af63f/users/fc76974c6d524f0c885a0f243ca0ae40/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:02.466960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.467573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.468453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.498628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:02.510058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] MFA Rules not processed for user `fc76974c6d524f0c885a0f243ca0ae40`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:02.511293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:02.607455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1097/2184] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:02.609669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.707820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608de2-9279-4c9b-899b-f8b2c6e8f132 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.712754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.713388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.713646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.713910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.714748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.716885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.748034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1088/2185] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:02.752715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.764367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082bda5-41eb-4fad-a3b5-8dd6f01ca882 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.832424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.833048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.833306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.833601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.834271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.836267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.885633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1098/2186] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:02 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:02.886998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.899725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbe5e6-14b1-47b0-8753-219193999b3d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.905453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.906317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.906607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.906912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.907542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.909229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.924887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1089/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:02.929335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:02.940112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74733bab-dba5-4f38-b5e6-052065650d0a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:02.945245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:02.945920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:02.946196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:02.946469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] PATH_INFO: `/v3/projects/026dc8f4d0e442d68b00891cca4116a3/users/9629de2cb5e64671a4ce71b6efdd2b52/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:02.966095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] RBAC: Authorizing `identity:create_grant(project_id=026dc8f4d0e442d68b00891cca4116a3, user_id=9629de2cb5e64671a4ce71b6efdd2b52, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:02.969280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:02.988621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1099/2188] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:02 2022] PUT /identity/v3/projects/026dc8f4d0e442d68b00891cca4116a3/users/9629de2cb5e64671a4ce71b6efdd2b52/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:02.993256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:03.007415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b0882-1bdf-429f-aef6-cd7f9b134e05 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.085604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:03.086237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.086520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.086801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.087588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:03.089378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f76b-f46e-4998-bce0-fa69774f88dd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:03.103013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1090/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:03.107117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:03.119216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a529a-fc1e-45bf-87fc-4c5d74c3956b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.125545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:03.126228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.126507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.126780 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] PATH_INFO: `/v3/projects/026dc8f4d0e442d68b00891cca4116a3/users/9629de2cb5e64671a4ce71b6efdd2b52/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.129281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] RBAC: Authorizing `identity:create_grant(project_id=026dc8f4d0e442d68b00891cca4116a3, user_id=9629de2cb5e64671a4ce71b6efdd2b52, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:03.131998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:03.147075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1100/2190] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:03 2022] PUT /identity/v3/projects/026dc8f4d0e442d68b00891cca4116a3/users/9629de2cb5e64671a4ce71b6efdd2b52/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:03.159040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.159417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.159798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.202238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] MFA Rules not processed for user `9629de2cb5e64671a4ce71b6efdd2b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:03.203885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.237544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:03.337735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1091/2191] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:03.351005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:03.354462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:03.484322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65222276-9d49-4cfd-887b-d2d1ccd182be admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.502684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:03.503871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.504166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.504474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.522857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:03.529417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:03.533375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397335d-ee2f-4a74-b1bf-e2c48f4b9c5d service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:03.564992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1101/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:03.694076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:03.709630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fe40-ab16-4e57-8484-97d3a7aca069 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:03.726994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:03.727824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:03.728543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:03.728913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:03.908291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:03.909804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:03.944606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1092/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:12.688960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2f62-ccde-4602-8756-4963db9f3c4a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:12.689466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2f62-ccde-4602-8756-4963db9f3c4a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:12.689466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa2f62-ccde-4602-8756-4963db9f3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:12.761243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c5fa2f62-ccde-4602-8756-4963db9f3c4a None None] MFA Rules not processed for user `5e8bbcb87073485aa05ae5813e0af779`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:12.762809 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c5fa2f62-ccde-4602-8756-4963db9f3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:12.951365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1102/2194] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:12.959519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:12.963656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.146725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c670d8-ebc9-4a4d-8bb8-1ac291d386c8 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.156488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.157773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.158275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.159110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.159996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.162393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.179712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.180457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.181102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.208847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1093/2195] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:12 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:13.210459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.241256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] MFA Rules not processed for user `e7cf1859de244861995386780e46f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:13.243051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.286542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:13.326636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615d6b4-9dbf-4a28-9e86-d43441e3221b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.341836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.342645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.343208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.343626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.344892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.346920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.373818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1094/2196] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:13 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:13.374997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.386670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371f3ad-9029-4a3b-8ae6-39700a44b2b5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.413207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.413849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.414132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.414376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.415039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.416720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.424568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1103/2197] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:13.446980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.450168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1095/2198] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:13.451888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.452830 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.479877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0958d-4096-4e79-93bb-631788c50048 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.496841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.497525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.497801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.498375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] PATH_INFO: `/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732/users/0df221ddc0e74b42afa0893371200402/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.535055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cb02ee0c3a4e2088dd17b3e2b93732, user_id=0df221ddc0e74b42afa0893371200402, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.537821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.567105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1096/2199] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:13 2022] PUT /identity/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732/users/0df221ddc0e74b42afa0893371200402/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:13.570834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.650776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f4fa7-a759-40d3-ae35-fbadd9fa2d5e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.674589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:13.717308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce6e57-8250-4b7b-b4d1-1d058d061915 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.723086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.723755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.724031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.724299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.725204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.727194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.742638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1097/2200] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:13.743635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.756321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7348-38fc-42db-a986-3f9e6c5ff23f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.762676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.763596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.764007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.764350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] PATH_INFO: `/v3/users/fc76974c6d524f0c885a0f243ca0ae40` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.765875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc76974c6d524f0c885a0f243ca0ae40)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.768033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.815756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.816547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.816923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.817290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.864048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc76974c6d524f0c885a0f243ca0ae40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:13.885506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc76974c6d524f0c885a0f243ca0ae40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:13.886274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc76974c6d524f0c885a0f243ca0ae40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:13.894382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc76974c6d524f0c885a0f243ca0ae40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:13.895275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc76974c6d524f0c885a0f243ca0ae40'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:13.909358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:13.919690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1098/2201] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:13 2022] DELETE /identity/v3/users/fc76974c6d524f0c885a0f243ca0ae40 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:13.925252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.928280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.934102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.937000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdb9f-b82f-4f87-b883-b6dcc196da84 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.961662 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1104/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:13.964835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.965393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.968483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.019721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:14.023010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:14.047222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d942-e419-475c-889b-e371b5bde885 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:14.059177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:14.061169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.064009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.065793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] PATH_INFO: `/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732/users/0df221ddc0e74b42afa0893371200402/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.070870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cb02ee0c3a4e2088dd17b3e2b93732, user_id=0df221ddc0e74b42afa0893371200402, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:14.078473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:14.110575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1099/2203] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:13 2022] PUT /identity/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732/users/0df221ddc0e74b42afa0893371200402/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:14.194815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1105/2204] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:14.225888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:14.228375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:14.403199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550313-6d26-4751-bb7e-dd141345d722 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:14.412553 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:14.413240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:14.413516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:14.413821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:14.596896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:14.600163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:14.626758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1100/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:16.164299 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:16.166597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:16.200803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99e50-6467-4b16-bc8d-c8321a6b0775 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:16.219416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:16.220196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.220697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.221216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] PATH_INFO: `/v3/projects/fdc86a8208264e42ac099d92c12af63f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.229427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc86a8208264e42ac099d92c12af63f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:16.231898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:16.454916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:16.460054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc86a8208264e42ac099d92c12af63f', 'request_id': 'req-5949ba05-fd28-418c-9d6a-da16fa7a5426'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:16.472125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc86a8208264e42ac099d92c12af63f', 'request_id': 'req-5949ba05-fd28-418c-9d6a-da16fa7a5426'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:16.491832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc86a8208264e42ac099d92c12af63f', 'request_id': 'req-5949ba05-fd28-418c-9d6a-da16fa7a5426'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:16.541734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] The token cache is being invalidate because project fdc86a8208264e42ac099d92c12af63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:16.541734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:16.541734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5949ba05-fd28-418c-9d6a-da16fa7a5426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:16.549974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1106/2206] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:16 2022] DELETE /identity/v3/projects/fdc86a8208264e42ac099d92c12af63f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:16.552130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:16.592948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dba10-0e07-4041-9015-bc28a138d2a7 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:16.804321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:16.845876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:16.847113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:16.847619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:16.848130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] PATH_INFO: `/v3/users/9629de2cb5e64671a4ce71b6efdd2b52` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:16.850476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9629de2cb5e64671a4ce71b6efdd2b52)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:16.856154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:17.006425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9629de2cb5e64671a4ce71b6efdd2b52'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:17.038801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9629de2cb5e64671a4ce71b6efdd2b52'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:17.041179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9629de2cb5e64671a4ce71b6efdd2b52'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:17.062149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9629de2cb5e64671a4ce71b6efdd2b52'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:17.063168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9629de2cb5e64671a4ce71b6efdd2b52'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:17.122660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1101/2207] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:16 2022] DELETE /identity/v3/users/9629de2cb5e64671a4ce71b6efdd2b52 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:19.073912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b5ec-67d2-4e09-8c44-cbfaf91dd46f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.074433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b5ec-67d2-4e09-8c44-cbfaf91dd46f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.075632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b5ec-67d2-4e09-8c44-cbfaf91dd46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.104794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.106781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.110092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f994b5ec-67d2-4e09-8c44-cbfaf91dd46f None None] MFA Rules not processed for user `e7cf1859de244861995386780e46f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:19.111568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f994b5ec-67d2-4e09-8c44-cbfaf91dd46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.201377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1107/2208] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:19.227385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c515380-9c1a-4e17-b4f1-efe9fbcf2c4d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.242839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.243519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.243801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.244129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] PATH_INFO: `/v3/projects/026dc8f4d0e442d68b00891cca4116a3` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.245266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026dc8f4d0e442d68b00891cca4116a3)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.247345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:19.362649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026dc8f4d0e442d68b00891cca4116a3', 'request_id': 'req-a01dbc11-460e-4980-8ad9-3f3872b98171'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:19.371963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026dc8f4d0e442d68b00891cca4116a3', 'request_id': 'req-a01dbc11-460e-4980-8ad9-3f3872b98171'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:19.385219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026dc8f4d0e442d68b00891cca4116a3', 'request_id': 'req-a01dbc11-460e-4980-8ad9-3f3872b98171'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:19.391114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:19.400727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] The token cache is being invalidate because project 026dc8f4d0e442d68b00891cca4116a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:19.401147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:19.402433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a01dbc11-460e-4980-8ad9-3f3872b98171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:19.407621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1102/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:19 2022] DELETE /identity/v3/projects/026dc8f4d0e442d68b00891cca4116a3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:19.410176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896e5fd-a541-4981-bbcd-eb277ea2ec1c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.410571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896e5fd-a541-4981-bbcd-eb277ea2ec1c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.410726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896e5fd-a541-4981-bbcd-eb277ea2ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.437285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8896e5fd-a541-4981-bbcd-eb277ea2ec1c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:19.438929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8896e5fd-a541-4981-bbcd-eb277ea2ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.534486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1108/2210] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:19.546662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593409-bc3f-4809-8005-1c541861e602 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.546963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593409-bc3f-4809-8005-1c541861e602 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.547231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593409-bc3f-4809-8005-1c541861e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.574475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8a593409-bc3f-4809-8005-1c541861e602 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:19.575046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8a593409-bc3f-4809-8005-1c541861e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.578051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e488b3-bd18-4da7-91f0-7bfa4322e515 None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.578930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e488b3-bd18-4da7-91f0-7bfa4322e515 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.579580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e488b3-bd18-4da7-91f0-7bfa4322e515 None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.581919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1109/2211] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:24:19.588462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1103/2212] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:19.590171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e488b3-bd18-4da7-91f0-7bfa4322e515 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.606416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e488b3-bd18-4da7-91f0-7bfa4322e515 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.612258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.613170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.613588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.613998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.614853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:19.615328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.617297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:19.636283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.636920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.637146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.637900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1110/2213] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:19.639025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.650999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004de5-c461-4e2e-8a1a-500d762a57fd admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.657426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.658055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.658329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.658641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.659312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.662397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:19.695711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] MFA Rules not processed for user `f06b3389210c46d787994abe138ce87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:19.697663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.717389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1111/2214] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:19.718736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.820945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:19.824467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1104/2215] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:19.846828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa2c6-ae3a-4455-9575-305de2959d6f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.850332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.852669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.852940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.853208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.853859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.856932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:19.871773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.880287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:19.923188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33324b5b-a9bb-4e94-a3c5-6054cd3b9601 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.927459 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1112/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:19 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:19.931800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:19.964442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15b55-7271-4f0c-8ef7-0ee483d17bb6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:19.985712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:19.987041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:19.987370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:19.987916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:19.989146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:19.994411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.033333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1113/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:20.035951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.045069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.047370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.048843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.051800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.070108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aa15b-6ef2-4299-a55a-b715eb5761f0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.094459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.097728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.097896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.098626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.099000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.099369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.100677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.103214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ad72-4123-40e7-80d5-168e489732d3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.115385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1105/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:20.133666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1114/2219] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:20.138249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.153600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aaceb-931e-4aa1-8f2b-7486b87e20d6 service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.163965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.165354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.165890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.166377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] PATH_INFO: `/v3/projects/3474cbcfc9b14647b8f661a6bc41b593/users/a1f6b43f434c43528c64e813a3ceab4c/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.185907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3474cbcfc9b14647b8f661a6bc41b593, user_id=a1f6b43f434c43528c64e813a3ceab4c, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.196768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.220970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1106/2220] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:20 2022] PUT /identity/v3/projects/3474cbcfc9b14647b8f661a6bc41b593/users/a1f6b43f434c43528c64e813a3ceab4c/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:20.229813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c080-b122-4312-861c-dea5656d8cba None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.230175 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c080-b122-4312-861c-dea5656d8cba None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.230568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c080-b122-4312-861c-dea5656d8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.299240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2965c080-b122-4312-861c-dea5656d8cba None None] MFA Rules not processed for user `a1f6b43f434c43528c64e813a3ceab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:20.309078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2965c080-b122-4312-861c-dea5656d8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:20.569375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1115/2221] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:20.571658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.635661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:20.654895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c0c6-31fc-4f32-89ac-1ebb5a80f7c9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.668260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.672165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.672165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.672165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.672165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.675428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.711988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1107/2222] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:20.714236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c080-b122-4312-861c-dea5656d8cba None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.731186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c080-b122-4312-861c-dea5656d8cba None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.830921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.831542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.831812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.832360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.833292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.839094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.875713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1116/2223] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:20 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:20.879569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.893974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4371f-3ed1-450d-92cb-3989c4390a70 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.903722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.904596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.904961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.905303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:20.905980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:20.908535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:20.931225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1108/2224] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:20.933065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:20.957900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf4ea6-a9e8-47f8-9c7e-06596cad0159 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:20.969924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:20.970720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:20.971003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:20.971323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] PATH_INFO: `/v3/projects/dcd0a8278e50467a9db37485923a5c0c/users/7be508a769224b3d83b4e8741385d41e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.011632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd0a8278e50467a9db37485923a5c0c, user_id=7be508a769224b3d83b4e8741385d41e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:21.015455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:21.017348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.019542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.050560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1117/2225] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:20 2022] PUT /identity/v3/projects/dcd0a8278e50467a9db37485923a5c0c/users/7be508a769224b3d83b4e8741385d41e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:21.051208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc4076-8eec-4f12-a01d-d5434793f9c8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:21.052022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.062906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:21.142979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:21.143794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.144085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.144465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] PATH_INFO: `/v3/users/2cf7fc34ce524052aafba9ce57dc6b89` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.145832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf7fc34ce524052aafba9ce57dc6b89)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:21.152844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:21.222685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649a99a-5f1a-4aea-9109-4c23898ac641 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:21.232838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:21.233796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.234264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.234683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.235555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:21.237897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:21.256233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1118/2226] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:21.257631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.272125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c655ccb-f47c-4789-9e1e-8b71af219cff admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:21.278901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:21.279957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.280475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.280963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] PATH_INFO: `/v3/projects/dcd0a8278e50467a9db37485923a5c0c/users/7be508a769224b3d83b4e8741385d41e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.286617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd0a8278e50467a9db37485923a5c0c, user_id=7be508a769224b3d83b4e8741385d41e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:21.290298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576b52d-2856-4b40-b297-746f22b60044 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:21.315117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf7fc34ce524052aafba9ce57dc6b89'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:21.317874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1119/2227] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:21 2022] PUT /identity/v3/projects/dcd0a8278e50467a9db37485923a5c0c/users/7be508a769224b3d83b4e8741385d41e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:21.320055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.320607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.321024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.346429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf7fc34ce524052aafba9ce57dc6b89'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:21.347490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf7fc34ce524052aafba9ce57dc6b89'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:21.361789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] MFA Rules not processed for user `7be508a769224b3d83b4e8741385d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:21.363548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.372736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf7fc34ce524052aafba9ce57dc6b89'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:21.374127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf7fc34ce524052aafba9ce57dc6b89'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:21.428605 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1109/2228] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:21 2022] DELETE /identity/v3/users/2cf7fc34ce524052aafba9ce57dc6b89 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:21.461110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1120/2229] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:21.474241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.477549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.565210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:21.590415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62754a0-449c-48d7-8802-2de0bfa35551 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:21.597084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:21.597832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:21.598205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:21.598585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:21.606389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.711826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:21.713823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:21.725767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1110/2230] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:21.867241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:21.868974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:21.976014 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b069c-74b4-4df2-ab40-ca529b5d3dd6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:22.004302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:22.067365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:22.068257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:22.068753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:22.069165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] PATH_INFO: `/v3/projects/5ffd27a014f34cfdbe95fb15b287da64` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:22.070508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffd27a014f34cfdbe95fb15b287da64)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:22.073852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:22.176442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffd27a014f34cfdbe95fb15b287da64', 'request_id': 'req-0649aeb7-6869-459e-981b-d8ab06c5332e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.209005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffd27a014f34cfdbe95fb15b287da64', 'request_id': 'req-0649aeb7-6869-459e-981b-d8ab06c5332e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.237469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffd27a014f34cfdbe95fb15b287da64', 'request_id': 'req-0649aeb7-6869-459e-981b-d8ab06c5332e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.275914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] The token cache is being invalidate because project 5ffd27a014f34cfdbe95fb15b287da64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:22.276208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.285008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.291229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1121/2231] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:21 2022] DELETE /identity/v3/projects/5ffd27a014f34cfdbe95fb15b287da64 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:22.292537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:22.311386 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc99c1-40a6-4761-8d7e-b7d0d96ace87 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:22.472469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:22.473242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:22.473597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:22.473968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] PATH_INFO: `/v3/users/8b665b7f1fae45b99c979eed660cd76b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:22.475285 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b665b7f1fae45b99c979eed660cd76b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:22.477614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:22.541194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b665b7f1fae45b99c979eed660cd76b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.573802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b665b7f1fae45b99c979eed660cd76b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.575013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b665b7f1fae45b99c979eed660cd76b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.587098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b665b7f1fae45b99c979eed660cd76b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.588916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-ac22da8b-a9d9-4250-b1a5-5b4da0173124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b665b7f1fae45b99c979eed660cd76b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:22.631980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1111/2232] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:22 2022] DELETE /identity/v3/users/8b665b7f1fae45b99c979eed660cd76b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:22.980360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:22.980360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:23.006674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649aeb7-6869-459e-981b-d8ab06c5332e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:23.113537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:23.114217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.114496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.114767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] PATH_INFO: `/v3/projects/1b796445ec174156b5c2f8655d25a138` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.116495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b796445ec174156b5c2f8655d25a138)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:23.119055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:23.213678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b796445ec174156b5c2f8655d25a138', 'request_id': 'req-67e3ccdf-da82-4f17-ae8b-1ed65506078a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:23.221592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:23.233688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b796445ec174156b5c2f8655d25a138', 'request_id': 'req-67e3ccdf-da82-4f17-ae8b-1ed65506078a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:23.244714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b796445ec174156b5c2f8655d25a138', 'request_id': 'req-67e3ccdf-da82-4f17-ae8b-1ed65506078a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:23.264555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] The token cache is being invalidate because project 1b796445ec174156b5c2f8655d25a138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:23.265181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:23.266308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-67e3ccdf-da82-4f17-ae8b-1ed65506078a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:23.271668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1122/2233] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:22 2022] DELETE /identity/v3/projects/1b796445ec174156b5c2f8655d25a138 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:23.273647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.273941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.274206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.303491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:23.304825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:23.333413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:23.438283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1112/2234] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:23.440821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.441104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.441375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.476515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:23.478134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:23.501140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1123/2235] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:23.503052 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:23.513757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943711cd-d810-466f-9158-ea2c6d927b19 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:23.521275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:23.521570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.521727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.521969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.522631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:23.522932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:23.524815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:23.550547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1113/2236] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:24:23.555036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:23.581655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebb4c-f554-435f-8633-c42ca78dc637 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:23.606452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:23.607237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.607565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.607981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.608925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:23.610986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:23.684308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1124/2237] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:23 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:23.687500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:23.724607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c89711-570d-4dcc-a4ae-94cd0ec67be1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:23.918588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:23.919290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:23.919676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:23.920096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:23.927319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:23.932919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.027058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1114/2238] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:23 2022] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:24.028270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.054167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71132a7d-1033-49c1-966e-554ed89dc045 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.071960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.073578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.073578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.075380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.082462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:24.083393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.100925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1125/2239] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:24.102431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.132213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578313bb-d1b2-4717-b7c9-4f6745eda4d2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.151803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.152753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.153248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.153716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.158865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:24.164379 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1fde6-f982-49ca-82c0-86396d5b48f3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.188482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1115/2240] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:24.194557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.213879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af35f5-aa5e-4098-8606-f47f243b6a36 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.253211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.253923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.254404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.254868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] PATH_INFO: `/v3/projects/5e50d432c1094b33aeb5dfe9993e163f/users/cb55a875f37d4908b4359d08b635c3e0/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.282547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e50d432c1094b33aeb5dfe9993e163f, user_id=cb55a875f37d4908b4359d08b635c3e0, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:24.285805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.308575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1126/2241] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:24 2022] PUT /identity/v3/projects/5e50d432c1094b33aeb5dfe9993e163f/users/cb55a875f37d4908b4359d08b635c3e0/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:24.322881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.323442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.323442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.360578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] MFA Rules not processed for user `cb55a875f37d4908b4359d08b635c3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:24.361982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:24.458981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1116/2242] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:24.463919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.574069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a63a-2911-4844-b146-bb2d79f142e1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.582137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.582837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.583265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.583739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.584788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:24.587842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.686487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1127/2243] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:24 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:24.692185 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.709927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203840a1-255a-4677-8db7-6cb9987409e8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:24.721261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:24.895648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:24.896299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:24.896613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:24.896921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:24.897564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:24.899562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:24.946980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1117/2244] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:24 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:24.956687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.969625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:24.988224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.000450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6442d-dfe5-4b2c-a39c-d9e84abfa235 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.018004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.018655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.019068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.019411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.021825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.024829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.046835 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1128/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:25.052520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:25.068973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a46cb-6ec3-46f2-9de4-58213c457df2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.081048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.081854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.083298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.083880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] PATH_INFO: `/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f/users/26d159f4520e4a2ea9f6afa13594fafb/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.135172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e91d30ff247c4a8fad297a44c2d6f, user_id=26d159f4520e4a2ea9f6afa13594fafb, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.146000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97d4e3-bb9d-404e-b597-7a93f2defa9d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.147288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.159556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.161232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.161643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.161988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.169207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.178054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1129/2246] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:25 2022] PUT /identity/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f/users/26d159f4520e4a2ea9f6afa13594fafb/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:25.183883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:25.290235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:25.385289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.386769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.391477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bae3f-2ed9-4257-950b-4deef12dece0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.399994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1118/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:25.410435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.411182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.411463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.411739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.412535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.414218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8b2c-0415-41cb-839b-d6d2aab7b2bb admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.440069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1130/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:25.446019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:25.461131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f07-af9f-4067-a954-3dd8a9750a5a service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.466853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.468638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.468638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.468638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] PATH_INFO: `/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f/users/26d159f4520e4a2ea9f6afa13594fafb/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.471216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e91d30ff247c4a8fad297a44c2d6f, user_id=26d159f4520e4a2ea9f6afa13594fafb, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:25.474633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd7bac-f62e-47eb-83cc-3570f779dc3a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:25.508431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1119/2249] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:25 2022] PUT /identity/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f/users/26d159f4520e4a2ea9f6afa13594fafb/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:25.516898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.517228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.517484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.527336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.527626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.527901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.563625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] MFA Rules not processed for user `26d159f4520e4a2ea9f6afa13594fafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:25.566250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.575828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] MFA Rules not processed for user `0df221ddc0e74b42afa0893371200402`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:25.578549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.632016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:25.691288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1131/2250] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:25.703372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:25.740116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1120/2251] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:25.757592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:25.759186 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:25.870434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b93088-3130-40a8-b63e-8d7a6f65ff57 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.899179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.900583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.901202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.901666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.940425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb083c-7243-4193-8c34-563505af2832 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:25.964370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:25.966907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:25.968576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:25.969622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:25.985515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:26.035174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:26.039604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4f6d-0c86-4dbf-9595-3531c316c9c2 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:26.087066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1132/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:26.199298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:26.202893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:26.222683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1121/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:28.715476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490288-a4ae-44ed-ae53-e87878319a04 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.716185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490288-a4ae-44ed-ae53-e87878319a04 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.716185 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490288-a4ae-44ed-ae53-e87878319a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.728314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:28.745687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8e490288-a4ae-44ed-ae53-e87878319a04 None None] MFA Rules not processed for user `5e8bbcb87073485aa05ae5813e0af779`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:28.747207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8e490288-a4ae-44ed-ae53-e87878319a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:28.755987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1133/2254] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:30.872540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:30.955179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1961bc-a383-4dac-a9df-1b1086e1d304 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:30.962965 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:30.963603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:30.963878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:30.964425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] PATH_INFO: `/v3/users/cb55a875f37d4908b4359d08b635c3e0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:30.966805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb55a875f37d4908b4359d08b635c3e0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:30.969296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:30.971562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:31.054763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb55a875f37d4908b4359d08b635c3e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.077127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb55a875f37d4908b4359d08b635c3e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.077127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb55a875f37d4908b4359d08b635c3e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.080212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb55a875f37d4908b4359d08b635c3e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.081034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb55a875f37d4908b4359d08b635c3e0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.112852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1122/2255] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:30 2022] DELETE /identity/v3/users/cb55a875f37d4908b4359d08b635c3e0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:31.114554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:31.114554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:31.114554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:31.135189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:31.136655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:31.225329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1134/2256] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:31.237151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:31.238610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:31.316907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb06a42-498e-46aa-8bbb-cf8d1b636acc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:31.320724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:31.321357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:31.321635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:31.321906 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:31.332582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:31.334068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:31.347095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1123/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:31.665837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:31.665837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:31.674429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca5234-6edd-4149-9991-e886b544c190 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:31.701773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:31.701773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:31.701773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:31.701773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] PATH_INFO: `/v3/projects/5e50d432c1094b33aeb5dfe9993e163f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:31.702146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e50d432c1094b33aeb5dfe9993e163f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:31.702146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:31.760366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e50d432c1094b33aeb5dfe9993e163f', 'request_id': 'req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.766489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e50d432c1094b33aeb5dfe9993e163f', 'request_id': 'req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.778321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e50d432c1094b33aeb5dfe9993e163f', 'request_id': 'req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.791218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] The token cache is being invalidate because project 5e50d432c1094b33aeb5dfe9993e163f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:31.791501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.792194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.793851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1135/2258] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:31 2022] DELETE /identity/v3/projects/5e50d432c1094b33aeb5dfe9993e163f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:31.798159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:31.809819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c52d-7eff-4dfc-a3c4-25c4042018b0 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:31.886005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:31.887612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:31.887612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:31.887612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] PATH_INFO: `/v3/users/26d159f4520e4a2ea9f6afa13594fafb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:31.888589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d159f4520e4a2ea9f6afa13594fafb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:31.891424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:31.921042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:31.951771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d159f4520e4a2ea9f6afa13594fafb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.968179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d159f4520e4a2ea9f6afa13594fafb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.969005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d159f4520e4a2ea9f6afa13594fafb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.978302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d159f4520e4a2ea9f6afa13594fafb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:31.979262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-4c0781e8-ed55-4ed0-a97d-8047f3e9097e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d159f4520e4a2ea9f6afa13594fafb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.000010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1124/2259] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:31 2022] DELETE /identity/v3/users/26d159f4520e4a2ea9f6afa13594fafb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:32.358050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:32.359832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:32.380484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee8b6a-5163-48ee-97ea-c0da16cfd83c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:32.500529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:32.501266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.502124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.502474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] PATH_INFO: `/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.504471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9e91d30ff247c4a8fad297a44c2d6f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:32.507559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:32.550823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:32.588058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9e91d30ff247c4a8fad297a44c2d6f', 'request_id': 'req-9ff45c2a-85fd-4c91-9b11-8a690063278b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.596557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9e91d30ff247c4a8fad297a44c2d6f', 'request_id': 'req-9ff45c2a-85fd-4c91-9b11-8a690063278b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.606006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9e91d30ff247c4a8fad297a44c2d6f', 'request_id': 'req-9ff45c2a-85fd-4c91-9b11-8a690063278b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.620174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] The token cache is being invalidate because project 8d9e91d30ff247c4a8fad297a44c2d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:32.620492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.621211 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9ff45c2a-85fd-4c91-9b11-8a690063278b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:32.623372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1136/2260] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:32 2022] DELETE /identity/v3/projects/8d9e91d30ff247c4a8fad297a44c2d6f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:32.630218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.630662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.631022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.664078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:32.665355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:32.735822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1125/2261] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:32.745324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.745561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.745894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.770321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:32.771590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:32.781975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1137/2262] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:32.786624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:32.798669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f516c-5f7a-40a1-8ef5-71823e8873ba None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:32.804338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:32.805017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.805299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.805572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.806238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:32.806546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:32.808651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:32.824790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1126/2263] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:32.830771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:32.842886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a819-68b8-437a-a54c-85c76599b3c0 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:32.848977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:32.849605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.849880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.850146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.850796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:32.852764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:32.887940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1138/2264] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:32 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:32.893037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:32.905119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162f69b-1188-4357-826d-04a1339bbd66 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:32.986429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:32.987067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:32.987347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:32.987616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:32.988300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:32.990420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:33.014062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1127/2265] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:32 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:33.018321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:33.030499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d9d9b-65f6-4b21-a281-0e4c92f190be admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:33.037421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:33.038041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.038309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.038577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.039220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:33.041114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:33.059542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1139/2266] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:33.064196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:33.076958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7942b-11f2-46b5-84af-5b6411caf441 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:33.082207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:33.082838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.083420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.083420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.084895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:33.085955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363368a9-3bb2-49ba-bc94-74597f2bbaba admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:33.099332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1128/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:33.104105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:33.116625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb4c7-21fc-445a-9c15-f825b7c4d43a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:33.122750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:33.123700 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.124018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.124288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] PATH_INFO: `/v3/projects/950b7ac1b4ff4507973afe890b279fc1/users/0104440ed7164eb395cb99ae775a83a5/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.142572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950b7ac1b4ff4507973afe890b279fc1, user_id=0104440ed7164eb395cb99ae775a83a5, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:33.145529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:33.167194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1140/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:33 2022] PUT /identity/v3/projects/950b7ac1b4ff4507973afe890b279fc1/users/0104440ed7164eb395cb99ae775a83a5/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:33.178935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af87e32-fc9b-442f-aff3-6fc9a14140b5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.179222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af87e32-fc9b-442f-aff3-6fc9a14140b5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.179494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af87e32-fc9b-442f-aff3-6fc9a14140b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.193912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:33.214393 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7af87e32-fc9b-442f-aff3-6fc9a14140b5 None None] MFA Rules not processed for user `0104440ed7164eb395cb99ae775a83a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:33.215659 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7af87e32-fc9b-442f-aff3-6fc9a14140b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:33.287862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1129/2269] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:33.300672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:33.302416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:33.371530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f41d6f-85d1-420c-b4cc-8ed0901caed1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:33.375764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:33.376417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:33.376680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:33.376970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:33.386435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:33.387882 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:33.398050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1141/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:39.801730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:39.802353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:39.802736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:39.830812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:39.832072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:39.915947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1130/2271] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:39.980894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:39.982908 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.059988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:40.089657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b531ba-73ad-4540-b987-59490e8cd8c2 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.097898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.098751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.098909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.099057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.109011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.110771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ef603-7741-41d4-b715-1b881b9b6b26 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.128489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1142/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:42.891670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:42.894143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:42.916308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374a4de-2dc1-4139-894e-79ae030302ab None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:42.923002 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:42.923763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:42.924030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:42.924301 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] PATH_INFO: `/v3/users/a1f6b43f434c43528c64e813a3ceab4c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:42.925570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f6b43f434c43528c64e813a3ceab4c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:42.927819 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:42.984515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f6b43f434c43528c64e813a3ceab4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.999224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f6b43f434c43528c64e813a3ceab4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.000112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f6b43f434c43528c64e813a3ceab4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.008724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f6b43f434c43528c64e813a3ceab4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.009508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f6b43f434c43528c64e813a3ceab4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.040879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1131/2273] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:42 2022] DELETE /identity/v3/users/a1f6b43f434c43528c64e813a3ceab4c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:43.041102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.041102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.041102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.057977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:43.059205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.135061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1143/2274] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:43.148639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.150189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.162902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:43.217480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e6e3-0870-479d-b26a-d0673099df2e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.221624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.222395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.222668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.222959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.233627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.235072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.247421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1132/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:43.583407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.584901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.606869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb1dd1-080b-4535-a5fe-d8756c65600d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.619934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.620726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.621075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.621544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] PATH_INFO: `/v3/projects/3474cbcfc9b14647b8f661a6bc41b593` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.623011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3474cbcfc9b14647b8f661a6bc41b593)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.625660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.693867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3474cbcfc9b14647b8f661a6bc41b593', 'request_id': 'req-fc33962a-0e14-498f-a33e-54f9bcc1cf44'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.702107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3474cbcfc9b14647b8f661a6bc41b593', 'request_id': 'req-fc33962a-0e14-498f-a33e-54f9bcc1cf44'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.714670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3474cbcfc9b14647b8f661a6bc41b593', 'request_id': 'req-fc33962a-0e14-498f-a33e-54f9bcc1cf44'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.730201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] The token cache is being invalidate because project 3474cbcfc9b14647b8f661a6bc41b593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:43.730687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.731688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.734289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1144/2276] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:43 2022] DELETE /identity/v3/projects/3474cbcfc9b14647b8f661a6bc41b593 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:43.739604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.753382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27f01d-086a-4a85-bd67-fe8c210082f0 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.878986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.881077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.881746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.882317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] PATH_INFO: `/v3/users/7be508a769224b3d83b4e8741385d41e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.893730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be508a769224b3d83b4e8741385d41e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.904462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.987466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be508a769224b3d83b4e8741385d41e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.001174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be508a769224b3d83b4e8741385d41e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.001910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be508a769224b3d83b4e8741385d41e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.009626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be508a769224b3d83b4e8741385d41e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.010400 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-cbbfdced-2246-4d49-b606-146ac1f6fbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be508a769224b3d83b4e8741385d41e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.031155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1133/2277] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:43 2022] DELETE /identity/v3/users/7be508a769224b3d83b4e8741385d41e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:44.344575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.344575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.361475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33962a-0e14-498f-a33e-54f9bcc1cf44 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.443208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.443934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.444204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.444493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] PATH_INFO: `/v3/projects/dcd0a8278e50467a9db37485923a5c0c` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.445614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd0a8278e50467a9db37485923a5c0c)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.447592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.449135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:44.517261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd0a8278e50467a9db37485923a5c0c', 'request_id': 'req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.525653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd0a8278e50467a9db37485923a5c0c', 'request_id': 'req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.536384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd0a8278e50467a9db37485923a5c0c', 'request_id': 'req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.550340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] The token cache is being invalidate because project dcd0a8278e50467a9db37485923a5c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:44.550340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.556228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8b1a6ca9-8435-4f9f-886d-44c306c0bd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:44.556228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1145/2278] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:44 2022] DELETE /identity/v3/projects/dcd0a8278e50467a9db37485923a5c0c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:44.561046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.561336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.561642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.582842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:44.584043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.615829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:44.656621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1134/2279] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:44.669172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.669667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.670343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.702723 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:44.703909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.713360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1146/2280] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:44.720639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.743129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f0e7a-0ea8-4bea-ad38-ba0f8d3666ee None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.749154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.749786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.750055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.750337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.750986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:44.751300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.752942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.771665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1135/2281] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:24:44.773717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.796817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e783b77-f43d-46a1-8431-11740a9ce411 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.808124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.809157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.809339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.809722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.811168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.813660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.878454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1147/2282] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:44.880088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.891952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15ff-8dc4-4c06-a1e4-5b89ea8ca68e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.981793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.982573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.982945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.983212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.983867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.985900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.023795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1136/2283] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:45.028826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.051158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe74de3-d682-471e-85a5-858fed1d13d0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.059379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.060446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.061222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.061682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.062520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.064951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.084113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1148/2284] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:45.088830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.125462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a73f1-1381-48ce-bee2-86ff471843c0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.145945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.146594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.146878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.147179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.147930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.150798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6492c45-7367-402c-a60a-286050424b6b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.173526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1137/2285] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:45.177711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.192854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7120197-0991-4b37-9636-99be23db372a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.201618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.202341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.202574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.202863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] PATH_INFO: `/v3/projects/8ede59e6b0c748149640cce278d9c39a/users/e1166f5a89b04eb0b98c1805d52d30a8/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.222841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ede59e6b0c748149640cce278d9c39a, user_id=e1166f5a89b04eb0b98c1805d52d30a8, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.225732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.242732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1149/2286] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:45 2022] PUT /identity/v3/projects/8ede59e6b0c748149640cce278d9c39a/users/e1166f5a89b04eb0b98c1805d52d30a8/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:45.253381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.253642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.253914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.286770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] MFA Rules not processed for user `e1166f5a89b04eb0b98c1805d52d30a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:45.288012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:45.366298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1138/2287] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:45.371099 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.452900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb97dd-62b9-45ef-9356-ba09d207f717 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.458009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.458632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.458911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.459181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.459824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.461784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.501043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1150/2288] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:45 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:45.505475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.519840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0fd5b-8bd5-4c56-9ae9-10e613ae6366 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.552646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:45.593552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.594273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.594459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.594739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.595458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.597683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.632437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1139/2289] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:45 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:45.637411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.648349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc22a-dcf1-4276-9e91-274c92cd8c2b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.653873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.654611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.654788 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.655031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.655695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.657520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.663989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:45.671054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1151/2290] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:45.680005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.703521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1a16e-b1cb-4760-8610-7b05c566f77c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.709602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.710345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.710635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.710988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] PATH_INFO: `/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf/users/2e4abdf7eca14cf592f22bb208e0bd82/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.731362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87562de1fce4ad7a3fc5a4ca2d5a0bf, user_id=2e4abdf7eca14cf592f22bb208e0bd82, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.734362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.749599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1140/2291] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:45 2022] PUT /identity/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf/users/2e4abdf7eca14cf592f22bb208e0bd82/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:45.753705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.765157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936aecf8-57d2-4f5a-8f2e-fc8dba538d1e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.839677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.840375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.840613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.841100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.842242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.843859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b3855-fec8-434c-98b1-4e1bce59479f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.854381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1152/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:45.859117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:45.879466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977f9e-f2c8-469f-94a3-ff82408be2f4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:45.885800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:45.886480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.886756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.887020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] PATH_INFO: `/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf/users/2e4abdf7eca14cf592f22bb208e0bd82/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.889743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87562de1fce4ad7a3fc5a4ca2d5a0bf, user_id=2e4abdf7eca14cf592f22bb208e0bd82, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:45.892620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:45.909061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1141/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:45 2022] PUT /identity/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf/users/2e4abdf7eca14cf592f22bb208e0bd82/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:45.921451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:45.921902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:45.922340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:45.973131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] MFA Rules not processed for user `2e4abdf7eca14cf592f22bb208e0bd82`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:45.975108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:46.063139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1153/2294] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:46.075305 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:46.078401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:46.153356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28bb64-377a-45d1-a838-7a6e9d327dab admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:46.157772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:46.158558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:46.158834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:46.159093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:46.176597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:46.183194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be3729-60e0-4413-89e2-bcbd23c76856 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:46.209658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1142/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:46.940352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:47.022172 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6b7e3-3a1c-4960-8436-f6802250b6c1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:47.029192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:47.029192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:47.029437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:47.029865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] PATH_INFO: `/v3/users/e1166f5a89b04eb0b98c1805d52d30a8` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:47.031412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1166f5a89b04eb0b98c1805d52d30a8)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:47.034084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:47.064653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:47.120862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1166f5a89b04eb0b98c1805d52d30a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:47.131704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1166f5a89b04eb0b98c1805d52d30a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:47.142854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1166f5a89b04eb0b98c1805d52d30a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:47.143737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1166f5a89b04eb0b98c1805d52d30a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:47.160992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1166f5a89b04eb0b98c1805d52d30a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:47.167881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1154/2296] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:46 2022] DELETE /identity/v3/users/e1166f5a89b04eb0b98c1805d52d30a8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:47.173772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:47.174555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:47.175761 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:47.201436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:47.202469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:47.273095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1143/2297] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:47.286393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:47.288051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:47.376148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069216e1-f8bc-4b45-8fa6-6aa09500c47a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:47.380927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:47.381829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:47.382140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:47.382431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:47.397061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:47.398711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5725d-8c28-495c-864f-8f6a6a4fb2ca service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:47.426077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1155/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:47.982416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:47.983103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:47.999581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdefca-9011-4f15-9946-8577c2e839c5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.004608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.005267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.005548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.005824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] PATH_INFO: `/v3/projects/8ede59e6b0c748149640cce278d9c39a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.009340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ede59e6b0c748149640cce278d9c39a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.011391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:48.038179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.076018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ede59e6b0c748149640cce278d9c39a', 'request_id': 'req-94bd8ffc-2528-4dc8-b830-5e161be1dc26'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.084582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ede59e6b0c748149640cce278d9c39a', 'request_id': 'req-94bd8ffc-2528-4dc8-b830-5e161be1dc26'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.090590 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.091167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.091167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.100968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ede59e6b0c748149640cce278d9c39a', 'request_id': 'req-94bd8ffc-2528-4dc8-b830-5e161be1dc26'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.115781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:48.117186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.117592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] The token cache is being invalidate because project 8ede59e6b0c748149640cce278d9c39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:48.117890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.118771 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.120650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1144/2299] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:47 2022] DELETE /identity/v3/projects/8ede59e6b0c748149640cce278d9c39a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:48.125066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.126789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.228819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1156/2300] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:48.243072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd8ffc-2528-4dc8-b830-5e161be1dc26 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.251230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.252718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.254714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.254714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] PATH_INFO: `/v3/users/2e4abdf7eca14cf592f22bb208e0bd82` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.256368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4abdf7eca14cf592f22bb208e0bd82)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.260044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:48.263996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.269220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.336025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4abdf7eca14cf592f22bb208e0bd82'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.356755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.387686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4abdf7eca14cf592f22bb208e0bd82'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.389132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4abdf7eca14cf592f22bb208e0bd82'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.403312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4abdf7eca14cf592f22bb208e0bd82'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.405005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4abdf7eca14cf592f22bb208e0bd82'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.414536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2a22b-8343-4ba6-b3e2-66a659d4a970 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.421469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1145/2301] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:48 2022] DELETE /identity/v3/users/2e4abdf7eca14cf592f22bb208e0bd82 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:48.436776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.437742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.438266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.438616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.441377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.456264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.457927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d316b-3171-472a-aa7b-fd0d71010dc0 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:48.474191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1157/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:48.822762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.825326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.886121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.957589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72c26f-6041-451f-9fdd-6269f3ec8f53 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.966824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.967938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.968284 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.968653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] PATH_INFO: `/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.969928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87562de1fce4ad7a3fc5a4ca2d5a0bf)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.972067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.116636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87562de1fce4ad7a3fc5a4ca2d5a0bf', 'request_id': 'req-5b356fcf-fd15-4fda-817e-6594eb031ffc'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.124629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87562de1fce4ad7a3fc5a4ca2d5a0bf', 'request_id': 'req-5b356fcf-fd15-4fda-817e-6594eb031ffc'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.134788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87562de1fce4ad7a3fc5a4ca2d5a0bf', 'request_id': 'req-5b356fcf-fd15-4fda-817e-6594eb031ffc'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.155084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] The token cache is being invalidate because project f87562de1fce4ad7a3fc5a4ca2d5a0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:49.155616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.156672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5b356fcf-fd15-4fda-817e-6594eb031ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.158937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1146/2303] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:48 2022] DELETE /identity/v3/projects/f87562de1fce4ad7a3fc5a4ca2d5a0bf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:49.164572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.165180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.165374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.194719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.196679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.289625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1158/2304] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.299095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.299773 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.300003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.326275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.327568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.336746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1147/2305] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.341874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.352260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075feb3-77db-41bd-9ee9-ad10cd69a4d0 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.357986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.358598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.358874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.359142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.359797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:49.361441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.361762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.375529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1159/2306] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:49.380709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.393523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87882f-e5c2-447e-a8c5-d00f0643afae None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.400872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.401910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.402439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.402943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.403813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.405930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.442646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1148/2307] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:49.447824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.459444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273d50-7903-44b3-b325-6d408bcf9cc0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.542975 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.544016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.544150 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.544587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.545694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.547661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.586471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1160/2308] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:49.593807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.611047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6ac6-1d4a-4d5b-9655-61b1d3edecff admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.616698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.617323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.617688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.618316 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.618544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.620165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.632286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1149/2309] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:49.637059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.648230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab852c-fdf1-4728-b9a7-a7ac84c19d8e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.657714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.658755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.659174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.659587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.660757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.664178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25669b-bb92-4812-9c28-8ebf050fbe83 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.684549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1161/2310] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:49.689509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.702132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52520-a31b-4a34-b12e-2bfcfcf4e2fe admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.708676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.709497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.709782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.710170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] PATH_INFO: `/v3/projects/f5853bb759264f529546c5ad6b20f413/users/6d069be2a1e24986b1a60de4ecc6ca5b/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.737896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5853bb759264f529546c5ad6b20f413, user_id=6d069be2a1e24986b1a60de4ecc6ca5b, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.741088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.758220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1150/2311] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:49 2022] PUT /identity/v3/projects/f5853bb759264f529546c5ad6b20f413/users/6d069be2a1e24986b1a60de4ecc6ca5b/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:49.831951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.832180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.832422 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.867522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] MFA Rules not processed for user `6d069be2a1e24986b1a60de4ecc6ca5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.868823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.905652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:49.965731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1162/2312] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.978705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.980679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.062173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce3792-45ab-4182-8fe2-458b582fadc2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:50.067150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:50.067903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.068070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.068348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.074210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:50.081514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:50.083679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32125d9d-3566-419f-af85-cce14cd879a4 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:50.109202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1151/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:50.126751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:50.213334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8f88e-37aa-4998-ab6e-9abf48993328 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:50.220341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:50.221021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.221307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.221599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] PATH_INFO: `/v3/users/6d069be2a1e24986b1a60de4ecc6ca5b` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.222978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d069be2a1e24986b1a60de4ecc6ca5b)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:50.231447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:50.330813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d069be2a1e24986b1a60de4ecc6ca5b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:50.343850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d069be2a1e24986b1a60de4ecc6ca5b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:50.357876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d069be2a1e24986b1a60de4ecc6ca5b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:50.359270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d069be2a1e24986b1a60de4ecc6ca5b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:50.380943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d069be2a1e24986b1a60de4ecc6ca5b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:50.398218 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1163/2314] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:50 2022] DELETE /identity/v3/users/6d069be2a1e24986b1a60de4ecc6ca5b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:50.400086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.401250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.401525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.433085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:50.434312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.506820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1152/2315] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:50.517776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:50.519326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.570177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:50.583952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed091a-dfe4-430b-9e5e-690fd5e2ad18 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:50.589318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:50.589960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:50.590377 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:50.590721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:50.603242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:50.604742 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:50.615890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1164/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:50.975829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:50.985852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:50.999431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d3703-f328-4b29-a6b1-1bc954a4f89c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:51.007248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:51.008114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:51.008494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:51.008935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] PATH_INFO: `/v3/projects/f5853bb759264f529546c5ad6b20f413` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:51.010009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5853bb759264f529546c5ad6b20f413)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:51.012283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:51.066159 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5853bb759264f529546c5ad6b20f413', 'request_id': 'req-672236d4-002e-443a-a041-5981e2b0e818'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:51.073490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5853bb759264f529546c5ad6b20f413', 'request_id': 'req-672236d4-002e-443a-a041-5981e2b0e818'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:51.082958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5853bb759264f529546c5ad6b20f413', 'request_id': 'req-672236d4-002e-443a-a041-5981e2b0e818'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:51.099182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] The token cache is being invalidate because project f5853bb759264f529546c5ad6b20f413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:51.099182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:51.100071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-672236d4-002e-443a-a041-5981e2b0e818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:51.125543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1153/2317] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:50 2022] DELETE /identity/v3/projects/f5853bb759264f529546c5ad6b20f413 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:54.958948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:54.960846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:54.977139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8537-5b3f-4b25-96ff-877f08439df1 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:55.042221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:55.042862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.043165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.043437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] PATH_INFO: `/v3/users/0104440ed7164eb395cb99ae775a83a5` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.044959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0104440ed7164eb395cb99ae775a83a5)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:55.046927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:55.103052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0104440ed7164eb395cb99ae775a83a5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.116013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0104440ed7164eb395cb99ae775a83a5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.132429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0104440ed7164eb395cb99ae775a83a5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.133269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0104440ed7164eb395cb99ae775a83a5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.149721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0104440ed7164eb395cb99ae775a83a5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.159466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1165/2318] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:54 2022] DELETE /identity/v3/users/0104440ed7164eb395cb99ae775a83a5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:55.165960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dd38-c813-42d7-8b65-477663f02122 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.166529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dd38-c813-42d7-8b65-477663f02122 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.166625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3dd38-c813-42d7-8b65-477663f02122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.187710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b3a3dd38-c813-42d7-8b65-477663f02122 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:55.189035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b3a3dd38-c813-42d7-8b65-477663f02122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.272413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1154/2319] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:55.283382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:55.285161 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.386407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3858e4-d862-45fa-a3f5-882bed335155 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:55.391155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:55.392130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.392622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.392891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.403550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:55.405225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:55.415584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1166/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:55.625307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.625740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.626080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.652524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:55.653903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.664195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1155/2321] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:55.692188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:55.694021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.711907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:55.750088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:55.751873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.775310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14592e60-ba47-480c-95b3-231e015b04d2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:55.781746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:55.782746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.782959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.783331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] PATH_INFO: `/v3/projects/950b7ac1b4ff4507973afe890b279fc1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.786044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950b7ac1b4ff4507973afe890b279fc1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:55.788408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:55.798321 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:55.846970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d712d70-5eb7-455c-87e4-ee27f008a8d5 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:55.871182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950b7ac1b4ff4507973afe890b279fc1', 'request_id': 'req-2991b7d7-132b-4dae-baf2-8d671fc62612'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.881716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950b7ac1b4ff4507973afe890b279fc1', 'request_id': 'req-2991b7d7-132b-4dae-baf2-8d671fc62612'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.895737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950b7ac1b4ff4507973afe890b279fc1', 'request_id': 'req-2991b7d7-132b-4dae-baf2-8d671fc62612'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.913999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] The token cache is being invalidate because project 950b7ac1b4ff4507973afe890b279fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:55.914368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.915136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2991b7d7-132b-4dae-baf2-8d671fc62612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:55.916748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1156/2322] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:55 2022] DELETE /identity/v3/projects/950b7ac1b4ff4507973afe890b279fc1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:55.922992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42ded-2588-48b8-adee-6d619741ae13 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.923275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42ded-2588-48b8-adee-6d619741ae13 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.923549 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42ded-2588-48b8-adee-6d619741ae13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.949588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cbb42ded-2588-48b8-adee-6d619741ae13 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:55.951399 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cbb42ded-2588-48b8-adee-6d619741ae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:55.969273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:55.970697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:55.970697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:55.970968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:55.978778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:56.053278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1157/2323] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:56.065974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.066448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.067177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.091081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:56.092990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:56.098785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.100653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.104007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1158/2324] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:56.109407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.113144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1167/2325] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:56.121087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9835e4-9986-414d-923c-f2b455c1bc49 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.126450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.127627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.127627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.128087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.128698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:56.129066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.130847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.155415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1159/2326] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:56.160280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.178413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f732e8-9ef1-444d-be1f-18c3db6ab640 service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.186953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.187985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.188550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.189031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.190079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.193795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.248191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1168/2327] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:56.254584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.273156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec9057-f57e-4875-84c1-1044dc42032f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.359009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.359645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.360046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.360326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.360998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.363047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.398412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1160/2328] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:56.400049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.412961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdc69-314f-42cd-baea-dd792eeb7469 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.417632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.418309 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.418676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.419063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.420264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.422255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.436606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1169/2329] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:56.440912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.448366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:56.453340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308eb2-3e70-4b7c-a4ae-86303410f6a2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.471124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.471124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.471124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.471124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.471544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.471544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0fd02-db66-40d9-bed9-c60e58b7beeb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.483356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1161/2330] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:56.488136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.499409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff519-4d16-47c5-b5ec-63edc62a4e9b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.504517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.505188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.505465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.505740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] PATH_INFO: `/v3/projects/bef25f1d9bf6442fa7087d2de6c2d956/users/e4fc8986e87648f48d9304e190c7f989/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.508255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:56.528592 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef25f1d9bf6442fa7087d2de6c2d956, user_id=e4fc8986e87648f48d9304e190c7f989, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.531424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.552130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1170/2331] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:56 2022] PUT /identity/v3/projects/bef25f1d9bf6442fa7087d2de6c2d956/users/e4fc8986e87648f48d9304e190c7f989/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:56.565013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.565298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.565576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.596610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] MFA Rules not processed for user `e4fc8986e87648f48d9304e190c7f989`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:56.598065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:56.682232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1162/2332] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:56.687768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.763033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be69a-4e9b-401e-82d1-f0f2f2c8201b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.769358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.770837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.770837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.770837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.771153 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.773267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.803914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1171/2333] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:56.807882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.819391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585eba9-ff3a-433e-a254-b92a5c15b029 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.889461 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.889775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.890017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.890384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.890840 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.893193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.918345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1163/2334] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:56 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:56.923845 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.935262 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e7ace-cef2-4115-9433-6c2dbd32ff40 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.940522 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.941107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.941384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.941653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.942305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.943953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:56.956038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1172/2335] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:56.961041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:56.973716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9aee8-8cfe-436e-84d8-0022d7847c71 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:56.987315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:56.987949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:56.988224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:56.988526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:56.989174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:56.990832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47d2a6-ddf8-4e7e-82f3-3b38d5bfb87f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.001959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1164/2336] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:57.006506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.017135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089f0cf-09a3-4367-9757-2dd6a7e4cc8d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.021991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.022683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.022932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.023204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] PATH_INFO: `/v3/projects/ca55f98817f045ad8e4d4357a8ee5f14/users/b92cec34607c4e4da85ae925d346e744/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.039363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca55f98817f045ad8e4d4357a8ee5f14, user_id=b92cec34607c4e4da85ae925d346e744, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.042862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c303d-385d-4b60-b171-cdea2d39f8e1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.060832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1173/2337] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:57 2022] PUT /identity/v3/projects/ca55f98817f045ad8e4d4357a8ee5f14/users/b92cec34607c4e4da85ae925d346e744/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:57.071648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.071754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.072094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.098131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.098460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.098770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.109960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] MFA Rules not processed for user `b92cec34607c4e4da85ae925d346e744`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:57.111177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.120330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] MFA Rules not processed for user `45c041b057d14b00b494d275bbdb079d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:57.121583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.164085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:57.185275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1165/2338] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:57.189502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.190216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1174/2339] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:57.268272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d90f-4c6c-47a7-8ed1-dd300c779b9d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.275062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.275692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.276017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.276278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.276960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.279307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.315588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1166/2340] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:57.318340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.332519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69e5c4-7b3f-4584-8a5f-01be54378a80 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.379510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:57.413379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.414088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.414469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.415242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.415793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.417784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.449678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1175/2341] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:57.453809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.476856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9134-fed9-47be-b9b7-dceddbbd69d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.487672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.488424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.488795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.489153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.489916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.491756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.511699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1167/2342] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:57.517314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.537275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77bdaf-92ba-4231-a771-b93a86a72931 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.544171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.545644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.546074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.546418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] PATH_INFO: `/v3/projects/11b56259c3064e0eaf517010533d5880/users/210cbf6737684d639bce14422de80caf/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.568499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b56259c3064e0eaf517010533d5880, user_id=210cbf6737684d639bce14422de80caf, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.572300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.601137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1176/2343] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:57 2022] PUT /identity/v3/projects/11b56259c3064e0eaf517010533d5880/users/210cbf6737684d639bce14422de80caf/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:57.603236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.615723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f63c3-3769-416b-84e0-3b7655dd53ff admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.695711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.696278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.696591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.696862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.697506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.699349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112c7aa-ee42-4c87-883f-d4b4a033b459 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.711693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1168/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:57.716797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.732157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618da0ad-4c7d-4645-819d-48ebf745627f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.735290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.735290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.735290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.737020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] PATH_INFO: `/v3/projects/11b56259c3064e0eaf517010533d5880/users/210cbf6737684d639bce14422de80caf/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.738475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b56259c3064e0eaf517010533d5880, user_id=210cbf6737684d639bce14422de80caf, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:57.741202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:57.753844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1177/2345] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:57 2022] PUT /identity/v3/projects/11b56259c3064e0eaf517010533d5880/users/210cbf6737684d639bce14422de80caf/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:57.766168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17403da-58be-4967-b11d-8b06116d2597 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.766625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17403da-58be-4967-b11d-8b06116d2597 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.766914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17403da-58be-4967-b11d-8b06116d2597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:57.798402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b17403da-58be-4967-b11d-8b06116d2597 None None] MFA Rules not processed for user `210cbf6737684d639bce14422de80caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:57.799672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b17403da-58be-4967-b11d-8b06116d2597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.860298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:57.891144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1169/2346] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:57.900304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:57.904214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:57.977652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92df-9329-46a8-bd14-d5cbb644e2d1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:57.982096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:57.982860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:57.983239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:57.983507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:58.064511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:58.066580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:58.079020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1178/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:00.715928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:00.717124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:00.717474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:00.744866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:00.746130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:00.795342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:00.797549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:00.810079 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac4d94-fad7-4a04-b5a4-161d01a4de4e service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:00.814104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:00.814824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:00.815097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:00.815526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:00.823451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1170/2348] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:25:00.866963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:00.880977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:00.883254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:00.889705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:00.891349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:00.902236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1179/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:00.991362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64555-37af-4705-865f-49f16fda44c5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:01.002703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:01.004074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:01.004074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:01.004074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:01.012895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:01.014718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04dc11-b814-4068-a47b-541f6316b5d5 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:01.027856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1171/2350] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:01.810106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:01.819286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28cb9c-f3df-487e-bbdd-8fd37630f444 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:01.823293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:01.824011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:01.824446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:01.825252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:01.836912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:01.838353 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:01.849551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1180/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:05.994930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.995560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.995560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.007382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:06.020717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705d1c6-2c26-42f0-8018-c7fb7b624429 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:06.029838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:06.030880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.031604 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.032439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:06.032838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] PATH_INFO: `/v3/users/e4fc8986e87648f48d9304e190c7f989` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.033861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.034876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fc8986e87648f48d9304e190c7f989)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:06.038066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:06.053058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1172/2352] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:06.083525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:06.085985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.115241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9683ad9-6872-4af0-a5f8-8105019eb670 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:06.116382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fc8986e87648f48d9304e190c7f989'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:06.128165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:06.129337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.129974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.130354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.130790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fc8986e87648f48d9304e190c7f989'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:06.147745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fc8986e87648f48d9304e190c7f989'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:06.149824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fc8986e87648f48d9304e190c7f989'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:06.154770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:06.160365 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c6425-0505-44a4-a424-593a53f02d15 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:06.171512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fc8986e87648f48d9304e190c7f989'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:06.183323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1173/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:25:06.186323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.186710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.187085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.194953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1181/2354] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:25:06 2022] DELETE /identity/v3/users/e4fc8986e87648f48d9304e190c7f989 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:25:06.233617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:06.234870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.333232 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:06.361220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1174/2355] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:06.371883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:06.374536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:06.491728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7e87-f00f-4bce-a1ba-5d865a7d21ef admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:06.497565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:06.498467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:06.498855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:06.499208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:06.512774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:06.514381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:06.526772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1182/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:07.035496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:07.038972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:07.054979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312230-c449-48e4-b41d-8b8546865e84 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:07.062170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:07.062932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:07.063279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:07.063561 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] PATH_INFO: `/v3/projects/bef25f1d9bf6442fa7087d2de6c2d956` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:07.065072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef25f1d9bf6442fa7087d2de6c2d956)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:07.067190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:07.131616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef25f1d9bf6442fa7087d2de6c2d956', 'request_id': 'req-3db990e5-1ce9-4b55-9945-2b1aadf32645'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.140018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef25f1d9bf6442fa7087d2de6c2d956', 'request_id': 'req-3db990e5-1ce9-4b55-9945-2b1aadf32645'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.153977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef25f1d9bf6442fa7087d2de6c2d956', 'request_id': 'req-3db990e5-1ce9-4b55-9945-2b1aadf32645'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.166682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] The token cache is being invalidate because project bef25f1d9bf6442fa7087d2de6c2d956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:25:07.167106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.167616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.169431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1175/2357] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:25:07 2022] DELETE /identity/v3/projects/bef25f1d9bf6442fa7087d2de6c2d956 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:07.174790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:07.186661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fb9b-be24-4478-9824-e7d0ccbce6da service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:07.243713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:07.270042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:07.271542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:07.271826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:07.272122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] PATH_INFO: `/v3/users/b92cec34607c4e4da85ae925d346e744` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:07.273432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92cec34607c4e4da85ae925d346e744)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:07.275398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:07.355599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92cec34607c4e4da85ae925d346e744'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.372145 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92cec34607c4e4da85ae925d346e744'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.381579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92cec34607c4e4da85ae925d346e744'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.382705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92cec34607c4e4da85ae925d346e744'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.398971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92cec34607c4e4da85ae925d346e744'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.405774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1183/2358] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:25:07 2022] DELETE /identity/v3/users/b92cec34607c4e4da85ae925d346e744 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:07.749652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:07.753023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:07.779455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db990e5-1ce9-4b55-9945-2b1aadf32645 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:07.847970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:07.848565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:07.848838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:07.849279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] PATH_INFO: `/v3/projects/ca55f98817f045ad8e4d4357a8ee5f14` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:07.850412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca55f98817f045ad8e4d4357a8ee5f14)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:07.852443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:07.912429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca55f98817f045ad8e4d4357a8ee5f14', 'request_id': 'req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.921236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca55f98817f045ad8e4d4357a8ee5f14', 'request_id': 'req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.931788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca55f98817f045ad8e4d4357a8ee5f14', 'request_id': 'req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.946518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] The token cache is being invalidate because project ca55f98817f045ad8e4d4357a8ee5f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:25:07.946808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.947460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:07.949263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1176/2359] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:25:07 2022] DELETE /identity/v3/projects/ca55f98817f045ad8e4d4357a8ee5f14 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:07.953261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:07.954893 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:07.972420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1a811-a377-40c4-a495-f1168f5125e0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:08.050712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:08.051378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.051757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.052043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] PATH_INFO: `/v3/users/210cbf6737684d639bce14422de80caf` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.053372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=210cbf6737684d639bce14422de80caf)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:08.055465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:08.119930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210cbf6737684d639bce14422de80caf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.136315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210cbf6737684d639bce14422de80caf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.145093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210cbf6737684d639bce14422de80caf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.145984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210cbf6737684d639bce14422de80caf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.148660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:08.166978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-40daf599-2b5e-4b28-865a-c24649935499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210cbf6737684d639bce14422de80caf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.173948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1184/2360] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:25:07 2022] DELETE /identity/v3/users/210cbf6737684d639bce14422de80caf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:08.544115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:08.545741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:08.559635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac38d0-1cbe-4fd6-80b7-ae9fbf631413 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:08.574567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:08.666809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:08.667483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.667768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.668077 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] PATH_INFO: `/v3/projects/11b56259c3064e0eaf517010533d5880` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.669388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b56259c3064e0eaf517010533d5880)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:08.671460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:08.731651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b56259c3064e0eaf517010533d5880', 'request_id': 'req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.739494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b56259c3064e0eaf517010533d5880', 'request_id': 'req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.750626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b56259c3064e0eaf517010533d5880', 'request_id': 'req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.766473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] The token cache is being invalidate because project 11b56259c3064e0eaf517010533d5880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:25:08.766638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.767419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7d31260e-6a24-41fd-b22f-9a02cdbb7e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:08.769191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1177/2361] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:25:08 2022] DELETE /identity/v3/projects/11b56259c3064e0eaf517010533d5880 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:08.774453 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.774996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.774996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.802571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:08.803947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:08.879242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1185/2362] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:08.887830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.888207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.888607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.917425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:08.918598 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:08.927256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1178/2363] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:25:08.931848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:08.942096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948006d7-ad49-4817-b2a5-90111bb9b5f2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:08.947015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:08.947751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.947886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.948134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.949648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:25:08.949648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:08.951351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:08.964776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1186/2364] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:25:08.971074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:08.982155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac59db-6f85-4ee3-a31c-f1db0df26715 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:08.987797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:08.988423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:08.988737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:08.989004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:08.989642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:08.991588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.025306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1179/2365] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:25:08 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:25:09.029879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.043960 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7d8da-e2af-42f8-bea6-8d44c3d7451d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.109158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.109769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.110075 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.110433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.111081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.113076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.138333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1187/2366] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:25:09 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:25:09.143113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.159805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3b9f-34ac-4ed3-ba25-6d71087a3001 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.163876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.164542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.164825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.165095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.165780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.167667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.180085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1180/2367] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:25:09.184460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.197143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82acd-1742-4ebd-b43f-b5a705eec435 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.204431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.205137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.205369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.205638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.206285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.207981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae8f5e-0da8-4e7f-b849-ab5c078fd4c9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.220629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1188/2368] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:25:09.225550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.237690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc600feb-926c-46bc-8b12-30253c35f744 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.244173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.245167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.245457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.245733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] PATH_INFO: `/v3/projects/264ab4b5777d4cd4977a290681c7354e/users/5643d2a1db7b430da5581b0f3a83a170/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.262986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=264ab4b5777d4cd4977a290681c7354e, user_id=5643d2a1db7b430da5581b0f3a83a170, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.265984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.284497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1181/2369] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:25:09 2022] PUT /identity/v3/projects/264ab4b5777d4cd4977a290681c7354e/users/5643d2a1db7b430da5581b0f3a83a170/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:09.298810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9eab-83d6-4612-9a99-2a3fd11f418c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.299093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9eab-83d6-4612-9a99-2a3fd11f418c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.299397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9eab-83d6-4612-9a99-2a3fd11f418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.332795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b42a9eab-83d6-4612-9a99-2a3fd11f418c None None] MFA Rules not processed for user `5643d2a1db7b430da5581b0f3a83a170`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:09.334213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b42a9eab-83d6-4612-9a99-2a3fd11f418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.379534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:09.409036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1189/2370] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:09.421745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:09.423437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:09.463315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:09.507093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c797c-2839-4eb2-a6a6-bc1df339ee4b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:09.511329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:09.511966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:09.512495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:09.512854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:09.524023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:09.526345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:09.536174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1182/2371] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:13.427368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:13.428129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:13.428129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:13.469595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:13.470860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:13.591168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1190/2372] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:13.621672 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:13.624294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:13.716967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee0006-ae7e-4c5b-a06d-35423a0b3f7e service glance] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:13.723475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:13.724111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:13.724409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:13.724706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:13.734189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:13.741663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:13.752816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1183/2373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:21.266937 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:21.268680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:21.354270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ec7ef-53c8-48f0-b710-8c6a24992240 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:21.361512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:21.362141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:21.362417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:21.362671 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:21.364504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:21.379013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:21.380665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3ff8-59f6-4774-b09c-65f04f5a966a service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:21.391408 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1191/2374] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:23.746158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=54 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:31.386543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=69 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:35.531879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:35.533537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:35.603534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af7d9-7022-4c93-afdc-bb3493cfdc05 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:35.608133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:35.608781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:35.609057 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:35.609320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:35.611256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:35.686826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:35.688692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:35.704945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1184/2375] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:40.725195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73b1a-00d3-456f-8954-039f0bbd4e0f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:40.725920 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73b1a-00d3-456f-8954-039f0bbd4e0f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:40.726021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73b1a-00d3-456f-8954-039f0bbd4e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:40.748457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dda73b1a-00d3-456f-8954-039f0bbd4e0f None None] MFA Rules not processed for user `f87b4b95703943b39dcb2f729ec2f244`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:40.749698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dda73b1a-00d3-456f-8954-039f0bbd4e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:40.809488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1192/2376] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:45.658331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:45.678302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fca641-3c2a-4d56-8a2e-3e6199697b20 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:45.685669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:45.686322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:45.686603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:45.686877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] PATH_INFO: `/v3/users/5643d2a1db7b430da5581b0f3a83a170` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:45.688045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5643d2a1db7b430da5581b0f3a83a170)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:45.690151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:45.743722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5643d2a1db7b430da5581b0f3a83a170'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:45.760697 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5643d2a1db7b430da5581b0f3a83a170'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:45.761650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5643d2a1db7b430da5581b0f3a83a170'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:45.770171 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5643d2a1db7b430da5581b0f3a83a170'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:45.770912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5643d2a1db7b430da5581b0f3a83a170'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:45.786256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1185/2377] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:25:45 2022] DELETE /identity/v3/users/5643d2a1db7b430da5581b0f3a83a170 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:45.791167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:45.791848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:45.792007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:45.818263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:45.819415 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:45.886270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1193/2378] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:45.896255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:45.897919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:45.927246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:45.963111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936e10-e31a-4451-8d50-f8bf21d81862 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:45.970028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:45.970933 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:45.971347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:45.971710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:45.985086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:45.986583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d828a-ea78-4ddc-92e9-001b3c2f5675 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:45.997718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1186/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:46.412740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.414360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:46.430930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ee941-2c9a-440d-aee9-8e1027cf4d3a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.437966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.438626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.438899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.439202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] PATH_INFO: `/v3/projects/264ab4b5777d4cd4977a290681c7354e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.440518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264ab4b5777d4cd4977a290681c7354e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.442687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.503065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264ab4b5777d4cd4977a290681c7354e', 'request_id': 'req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:46.509602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264ab4b5777d4cd4977a290681c7354e', 'request_id': 'req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:46.519851 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264ab4b5777d4cd4977a290681c7354e', 'request_id': 'req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:46.535270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] The token cache is being invalidate because project 264ab4b5777d4cd4977a290681c7354e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:25:46.535810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:46.536321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f557ccfa-e72a-4b8a-bb2b-9f706f8433a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:46.537910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1194/2380] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:25:46 2022] DELETE /identity/v3/projects/264ab4b5777d4cd4977a290681c7354e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:46.543473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.543743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.544001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.567961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:46.569308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:46.654766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1187/2381] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:46.663131 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.663369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.663658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.685328 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:46.686427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:46.695027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1195/2382] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:46.699596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.713038 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4391c3-d9ff-40c7-bc48-5c132532b6f7 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.720378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.721291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.721639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.721977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.722947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:25:46.723625 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.725749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.738923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1188/2383] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:25:46.743588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.753350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195445-99cc-4cd1-8f9a-1ada1d8f3970 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.758568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.759151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.759432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.759695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.760666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.762350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.785320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:46.792988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1196/2384] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:25:46.797448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.808111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c64fa8-73a4-4bee-ad29-b48f8f4d89c1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.872488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.873136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.873414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.873686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.874350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.876324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.913289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1189/2385] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:25:46 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:25:46.920116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.932938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252956c1-e0bf-4415-af76-82fee9cd7032 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.938904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.939425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.939713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.939980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.940660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.942291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.953687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1197/2386] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:25:46.958142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:46.969704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0673b-0cab-4c42-b8b2-8ae7769b56c4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:46.975864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:46.976547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:46.976828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:46.977098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:46.977797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:46.979482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb809-d836-4e45-a600-acac0b145e07 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:46.991668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1190/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:25:46.996818 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:47.007971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb63ff3-8f41-467e-b140-ee14c39a2945 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:47.013215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:47.013885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:47.014159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:47.014424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] PATH_INFO: `/v3/projects/95887ff7eca24072b02a50e2a54fcdad/users/22e9d1ef6b6243a4808b6ef509857dd1/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:47.030728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95887ff7eca24072b02a50e2a54fcdad, user_id=22e9d1ef6b6243a4808b6ef509857dd1, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:47.033430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:47.048990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1198/2388] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:25:46 2022] PUT /identity/v3/projects/95887ff7eca24072b02a50e2a54fcdad/users/22e9d1ef6b6243a4808b6ef509857dd1/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:25:47.060887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b152e-4afc-4f95-a384-64ec1e6dd2ba None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:47.061250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b152e-4afc-4f95-a384-64ec1e6dd2ba None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:47.061538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b152e-4afc-4f95-a384-64ec1e6dd2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:47.092633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-fd1b152e-4afc-4f95-a384-64ec1e6dd2ba None None] MFA Rules not processed for user `22e9d1ef6b6243a4808b6ef509857dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:47.093860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fd1b152e-4afc-4f95-a384-64ec1e6dd2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:47.114937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:47.176060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1191/2389] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:25:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:47.187736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:47.189591 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:47.258706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bd67-bf68-4f3c-a515-0c43d1dcc184 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:47.263005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:47.263628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:47.263902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:47.264157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:47.273832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:47.275284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:47.286731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1199/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:56.246367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959ec0-bc6f-46c8-8223-0160203aabf5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:56.246970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959ec0-bc6f-46c8-8223-0160203aabf5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:56.246970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e959ec0-bc6f-46c8-8223-0160203aabf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:56.269871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4e959ec0-bc6f-46c8-8223-0160203aabf5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:56.271131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e959ec0-bc6f-46c8-8223-0160203aabf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:56.340498 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1192/2391] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:56.373505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:56.377198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:56.461881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafaa81-83c9-4890-87ca-6d7f5842c95e service glance] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:56.468319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:56.468972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:56.469250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:56.469521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:56.478816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:56.480416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:56.490177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1200/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:01.912211 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4492dd-8275-4385-8cf1-5f065ab2964f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:01.913454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4492dd-8275-4385-8cf1-5f065ab2964f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:01.913454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4492dd-8275-4385-8cf1-5f065ab2964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:01.934588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bf4492dd-8275-4385-8cf1-5f065ab2964f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:01.935815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bf4492dd-8275-4385-8cf1-5f065ab2964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:01.945170 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1193/2393] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:02.085347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:02.086869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:02.102819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf927de4-35a0-4cfb-9c6f-598e75789126 service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:02.109189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:02.109797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:02.110066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:02.110363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:02.119313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:02.121023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:02.131190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1201/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:26:06.757451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee29f8-50a7-40b2-8347-396162387b17 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:06.758034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee29f8-50a7-40b2-8347-396162387b17 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:06.758034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee29f8-50a7-40b2-8347-396162387b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:06.784050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b8ee29f8-50a7-40b2-8347-396162387b17 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:06.785311 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b8ee29f8-50a7-40b2-8347-396162387b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:06.795372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1194/2395] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:26:06.821291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:06.833373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fffa23-b910-4768-8f9b-a0c435dbfa0b service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:06.844085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:06.844749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:06.845017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:06.845294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:06.855399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:06.857284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:06.869540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1202/2396] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:13.029772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca3f0-3256-41d5-9b1d-0dbafc522c79 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:13.030412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca3f0-3256-41d5-9b1d-0dbafc522c79 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:13.030412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ca3f0-3256-41d5-9b1d-0dbafc522c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:13.054137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0a1ca3f0-3256-41d5-9b1d-0dbafc522c79 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:13.055263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0a1ca3f0-3256-41d5-9b1d-0dbafc522c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:13.063843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1195/2397] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:13.092158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:13.105707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9af38-88e5-4eda-a40b-28a5f70e781b service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:13.112737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:13.113439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:13.113717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:13.113969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:13.123577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:13.125226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:13.136002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1203/2398] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:18.305133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:18.305936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:18.305936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:18.315262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=55 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:18.329242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:18.330493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:18.339335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1196/2399] 10.222.0.71 () {58 vars in 1016 bytes} [Mon Aug 29 20:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:18.371926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:18.379916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:18.388460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a57c8-3a9c-4afe-83ca-80ef69fabd95 service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:18.403847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:18.404524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:18.405286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:18.405793 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:18.425562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:18.427264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52b045-8128-4430-b913-33fe3c4ffa4c service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:18.438829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1204/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:21.889912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:21.901267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e543bf-33c3-40da-b414-be47b0886a43 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:21.907497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:21.908467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:21.908648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:21.908997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] PATH_INFO: `/v3/users/22e9d1ef6b6243a4808b6ef509857dd1` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:21.910757 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e9d1ef6b6243a4808b6ef509857dd1)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:21.913210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:21.974531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e9d1ef6b6243a4808b6ef509857dd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:21.991390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e9d1ef6b6243a4808b6ef509857dd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:21.992451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e9d1ef6b6243a4808b6ef509857dd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:21.999937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e9d1ef6b6243a4808b6ef509857dd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.000614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e9d1ef6b6243a4808b6ef509857dd1'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.019135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1197/2401] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:26:21 2022] DELETE /identity/v3/users/22e9d1ef6b6243a4808b6ef509857dd1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:22.027044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.027516 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.027647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.056757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:22.058028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:22.126917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1205/2402] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:22.139643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:22.141315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:22.214741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017309d-ff32-41f6-85a3-ecd35a0c8246 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:22.220787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:22.221680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.222046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.222433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.234602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:22.236088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27867-0724-4d57-ba94-cd834d4753be service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:22.246866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1198/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:22.551362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:22.552872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:22.573091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23617e7-6d60-4b33-86d3-b3a8bd36f244 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:22.577728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:22.578367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.578919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.579190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] PATH_INFO: `/v3/projects/95887ff7eca24072b02a50e2a54fcdad` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.580348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95887ff7eca24072b02a50e2a54fcdad)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:22.582485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:22.669674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95887ff7eca24072b02a50e2a54fcdad', 'request_id': 'req-5c05ea1a-7937-4c67-8034-f96b70126866'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.677366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95887ff7eca24072b02a50e2a54fcdad', 'request_id': 'req-5c05ea1a-7937-4c67-8034-f96b70126866'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.692008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95887ff7eca24072b02a50e2a54fcdad', 'request_id': 'req-5c05ea1a-7937-4c67-8034-f96b70126866'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.705155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] The token cache is being invalidate because project 95887ff7eca24072b02a50e2a54fcdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:26:22.705487 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.709105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5c05ea1a-7937-4c67-8034-f96b70126866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:22.712582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1206/2404] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:26:22 2022] DELETE /identity/v3/projects/95887ff7eca24072b02a50e2a54fcdad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:22.718973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.719378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.719756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.743644 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:22.745152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:22.832845 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1199/2405] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:22.842570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.842741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.843016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.872195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:22.873593 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:22.882403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1207/2406] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:22.887056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:22.897522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c20d3-4edd-46db-adc6-bb28fb6d3bdc None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:22.903256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:22.903888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.904164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.904556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.905215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:26:22.905518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:22.907195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:22.915440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:22.922420 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1200/2407] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:26:22.927070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:22.943097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895db13-7663-4163-99b4-d2d510a16103 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:22.949361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:22.950008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:22.950281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:22.950545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:22.951202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:22.953167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:22.985028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1208/2408] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:26:22 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:26:22.993966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:23.004847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598334-1b53-472d-a76a-e4b24f4a8ae4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:23.076786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:23.077317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.077615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.077902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.078518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:23.080488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:23.104214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1201/2409] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:26:22 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:26:23.112226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:23.124617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b74710-c140-4795-9d30-b6a2fca873d1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:23.130745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:23.131354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.131631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.131895 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.132584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:23.134434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:23.145073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1209/2410] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:23.150345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:23.164358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2fc1c-9e5b-470e-a220-8d61cb0a9766 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:23.170167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:23.170715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.171013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.171261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.171911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:23.173594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968992b-5ed0-4d17-b10f-5c3c2a543540 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:23.184859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1202/2411] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:23.189182 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:23.200524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a827dc-097a-495f-954d-1c3510cf34b9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:23.206805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:23.207463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.207764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.208035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] PATH_INFO: `/v3/projects/d195508b03e446a6b712dd2a9be6a76d/users/4d3a5cd2bbe44d8ca769f64ad02b4409/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.225565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d195508b03e446a6b712dd2a9be6a76d, user_id=4d3a5cd2bbe44d8ca769f64ad02b4409, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:23.228409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:23.244994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1210/2412] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:26:23 2022] PUT /identity/v3/projects/d195508b03e446a6b712dd2a9be6a76d/users/4d3a5cd2bbe44d8ca769f64ad02b4409/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:23.255442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82bf0-6ee5-402c-b54f-249646ffa20c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.255727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82bf0-6ee5-402c-b54f-249646ffa20c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.256000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82bf0-6ee5-402c-b54f-249646ffa20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.285271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-68c82bf0-6ee5-402c-b54f-249646ffa20c None None] MFA Rules not processed for user `4d3a5cd2bbe44d8ca769f64ad02b4409`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:23.286505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-68c82bf0-6ee5-402c-b54f-249646ffa20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:23.363455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1203/2413] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:23.376800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:23.378743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:23.391482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:23.442789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97e45-0a6e-480d-8048-fe883e1c95fc admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:23.446668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:23.447265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:23.447534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:23.447795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:23.456624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:23.458045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d351a5-775f-4428-8b45-10bf6a884bd8 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:23.469881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1211/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:24.880534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:24.881086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:24.881086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:24.923246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] MFA Rules not processed for user `4d3a5cd2bbe44d8ca769f64ad02b4409`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:24.924681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:24.942700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1204/2415] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:33.464659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=22 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:34.908460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:51.606467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f05-923f-4bda-bc33-4c05b2df1692 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:51.607051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f05-923f-4bda-bc33-4c05b2df1692 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:51.607051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f05-923f-4bda-bc33-4c05b2df1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:51.627974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-42ed3f05-923f-4bda-bc33-4c05b2df1692 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:51.629197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-42ed3f05-923f-4bda-bc33-4c05b2df1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:51.700943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1212/2416] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:26:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:51.748715 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:51.750324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:51.823124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858592cc-2510-418d-8eac-c89c2ad26385 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:51.828216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:51.828868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:51.829148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:51.829443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:51.838131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:51.839732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:51.848042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1205/2417] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:52.433970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645a13-ab31-4683-890f-ac14495dc516 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:52.434326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645a13-ab31-4683-890f-ac14495dc516 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:52.434664 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645a13-ab31-4683-890f-ac14495dc516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:52.457059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5d645a13-ab31-4683-890f-ac14495dc516 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:52.458312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5d645a13-ab31-4683-890f-ac14495dc516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:52.466682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1213/2418] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:52.480843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:52.492874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46364f-1055-4b9d-a233-37d00326ed54 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:52.498252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:52.498865 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:52.499145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:52.499434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:52.507905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:52.509517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:52.519709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1206/2419] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:52.817438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d947-7dfe-49fa-9226-4fa3ebc88245 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:52.817905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d947-7dfe-49fa-9226-4fa3ebc88245 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:52.818036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d947-7dfe-49fa-9226-4fa3ebc88245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:52.843359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-1092d947-7dfe-49fa-9226-4fa3ebc88245 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:52.844684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1092d947-7dfe-49fa-9226-4fa3ebc88245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:52.853682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1214/2420] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:52.866206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:52.878994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e0aba-dafc-4903-ba00-9a784f470b67 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:52.885587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:52.886205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:52.886486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:52.886781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:52.895989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:52.898585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:52.907551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1207/2421] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:53.301027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:53.301455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:53.301789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:53.325531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:53.326756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:53.336583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1215/2422] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:26:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:53.351496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:53.368323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316423eb-3597-4c63-91de-ecd7e8222f95 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:53.374528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:53.375133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:53.375410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:53.375681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:53.385418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:53.387041 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:53.395690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1208/2423] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:26:54.110232 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:54.111993 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:54.192986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c309aa-1417-4cc5-8672-e799bd3a8206 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:54.199124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:54.199762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.200034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.200300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] PATH_INFO: `/v3/users/f87b4b95703943b39dcb2f729ec2f244` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.201598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87b4b95703943b39dcb2f729ec2f244)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:54.203395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:54.256371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87b4b95703943b39dcb2f729ec2f244'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.265583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87b4b95703943b39dcb2f729ec2f244'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.274444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87b4b95703943b39dcb2f729ec2f244'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.275126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87b4b95703943b39dcb2f729ec2f244'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.288303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-d14e270e-2651-48b8-80eb-fdffbcf2357e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87b4b95703943b39dcb2f729ec2f244'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.294559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1216/2424] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:26:54 2022] DELETE /identity/v3/users/f87b4b95703943b39dcb2f729ec2f244 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:54.499370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:54.512988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf617ee8-a0bc-49b9-a39b-d48c2cb0315f service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:54.594270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:54.594921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.595204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.595476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] PATH_INFO: `/v3/projects/200bb771342544a5be2157c8a553d73e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.596756 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200bb771342544a5be2157c8a553d73e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:54.598830 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:54.661081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200bb771342544a5be2157c8a553d73e', 'request_id': 'req-445d8f72-248c-4244-b977-af6892b7cdd9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.664043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:54.673787 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200bb771342544a5be2157c8a553d73e', 'request_id': 'req-445d8f72-248c-4244-b977-af6892b7cdd9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.685847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200bb771342544a5be2157c8a553d73e', 'request_id': 'req-445d8f72-248c-4244-b977-af6892b7cdd9'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.698744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] The token cache is being invalidate because project 200bb771342544a5be2157c8a553d73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:26:54.699035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.699687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-445d8f72-248c-4244-b977-af6892b7cdd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:54.701249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1209/2425] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:26:54 2022] DELETE /identity/v3/projects/200bb771342544a5be2157c8a553d73e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:26:54.706988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.707272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.707653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.718589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:54.733814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:54.735706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:54.797108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1217/2426] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:54.805323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.805628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.805928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.828116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:54.829354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:54.839209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1210/2427] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:54.845356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:54.860645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e7f5b-cd99-4d17-8e7c-50d1a4b068ba None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:54.868626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:54.869271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.869549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.869862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.870521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:26:54.870820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:54.872456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:54.885714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1218/2428] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:26:54.890507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:54.901578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f708f-814b-4c6e-95de-51eaa280f038 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:54.906533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:54.907140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:54.907419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:54.907687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:54.908346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:54.910322 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:54.942858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1211/2429] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:26:54 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:26:54.948519 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:54.962839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65b03-c915-4bbf-97ae-43e61521e02c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.030129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.030775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.031081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.031355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.032055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.034169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.060210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1219/2430] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:26:54 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:26:55.070124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.081400 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da293f-c119-4e27-9d6b-b5e3a81ea4f2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.087230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.087841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.088127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.088439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.089094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.090703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.101639 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1212/2431] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:55.106261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.120225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d178db-ad16-46f8-9e75-626e2a190fd4 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.125505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.126106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.126387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.126653 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.127331 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.129057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f6a2-5035-41b8-a24e-80fbcecf7cdc admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.141507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1220/2432] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:26:55.146463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.162592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18629-b8fd-4e38-a5f6-53bc4d2b42fc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.169604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.170277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.170648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.170915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] PATH_INFO: `/v3/projects/26ba525f8fb049a1a15b62a68aa842f5/users/5289d1a0799842e98e6e146fffcc990d/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.188585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ba525f8fb049a1a15b62a68aa842f5, user_id=5289d1a0799842e98e6e146fffcc990d, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.191262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.207325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1213/2433] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:26:55 2022] PUT /identity/v3/projects/26ba525f8fb049a1a15b62a68aa842f5/users/5289d1a0799842e98e6e146fffcc990d/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:55.212940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.213320 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.213683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.240649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:55.242690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:55.314813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1221/2434] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:55.324959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.326729 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:55.390501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dc633-2704-4380-9f17-0fd2febc73af admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.395696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.396667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.397101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.397588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.413564 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.414942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841b3c-fa7f-47cd-b8f6-514734baade0 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.428521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1214/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:55.599709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.601622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:55.614205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52bcf7-bdb0-41e5-83de-00f6704689ce None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.621565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.622494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.622813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.623112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] PATH_INFO: `/v3/users/4d3a5cd2bbe44d8ca769f64ad02b4409` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.624496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3a5cd2bbe44d8ca769f64ad02b4409)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.627016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.634858 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:55.686187 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3a5cd2bbe44d8ca769f64ad02b4409'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:55.694702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3a5cd2bbe44d8ca769f64ad02b4409'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:55.702623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3a5cd2bbe44d8ca769f64ad02b4409'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:55.703373 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3a5cd2bbe44d8ca769f64ad02b4409'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:55.717113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3a5cd2bbe44d8ca769f64ad02b4409'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:55.724439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1222/2436] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:26:55 2022] DELETE /identity/v3/users/4d3a5cd2bbe44d8ca769f64ad02b4409 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:55.729010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.729952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.730297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.752095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:55.754213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:55.821952 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1215/2437] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:26:55.833327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:55.834899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:55.901958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f75da-65eb-47f2-8020-8944c2907524 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:55.905846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:55.906463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:55.906751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:55.907001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:55.917156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:55.918887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24fe31-64e0-40f9-bce5-deb286aae8f0 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:55.929803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1223/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:26:56.334743 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:56.337318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:56.357273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df0be-5d51-49bb-86e6-2a009091a7a1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:56.362384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:56.364096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:56.364096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:56.364096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] PATH_INFO: `/v3/projects/d195508b03e446a6b712dd2a9be6a76d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:56.365191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d195508b03e446a6b712dd2a9be6a76d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:56.367475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:56.391676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:26:56.434458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd195508b03e446a6b712dd2a9be6a76d', 'request_id': 'req-31f209cf-5d05-46e5-ba70-662ee34efab3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:56.444088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd195508b03e446a6b712dd2a9be6a76d', 'request_id': 'req-31f209cf-5d05-46e5-ba70-662ee34efab3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:56.453383 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd195508b03e446a6b712dd2a9be6a76d', 'request_id': 'req-31f209cf-5d05-46e5-ba70-662ee34efab3'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:56.470519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] The token cache is being invalidate because project d195508b03e446a6b712dd2a9be6a76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:26:56.471208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:56.472108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:26:56.474554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1216/2439] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:26:56 2022] DELETE /identity/v3/projects/d195508b03e446a6b712dd2a9be6a76d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:26:59.690679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:59.691203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:59.691394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:59.725492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] MFA Rules not processed for user `5289d1a0799842e98e6e146fffcc990d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:26:59.726716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:59.807753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1224/2440] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:26:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:26:59.812418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:59.813934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:26:59.919782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f209cf-5d05-46e5-ba70-662ee34efab3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:26:59.925252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:26:59.925936 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:26:59.926214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:26:59.926464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:26:59.927113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:26:59.929693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:26:59.961222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1217/2441] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:26:59 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:26:59.965403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:26:59.995366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4006e8-6ee0-4ae0-be74-42cc387d071a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:00.011456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:00.064965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:00.065587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:00.066038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:00.066154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:00.066778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:00.069098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:00.093432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1225/2442] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:26:59 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:27:00.097838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:00.109907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d5d0-1dec-49ef-b23e-12ed3afec2b4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:00.114892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:00.115583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:00.115922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:00.116279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:00.117105 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:00.119409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:00.131053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1218/2443] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:27:00.135607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:00.150190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f5930-ec93-41d0-851b-ecea8b3042e0 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:00.155189 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:00.155877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:00.156155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:00.156479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] PATH_INFO: `/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8/users/a327fd8f354b406b948994d94eb4177a/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:00.174966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce41af75d5147a0b739ac47eb8d02b8, user_id=a327fd8f354b406b948994d94eb4177a, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:00.177795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:00.192791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1226/2444] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:27:00 2022] PUT /identity/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8/users/a327fd8f354b406b948994d94eb4177a/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:27:00.196970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:00.207953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cceae-8be5-4281-942b-a2918364b3ef admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:00.273049 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:00.273667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:00.273940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:00.274208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:00.274849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:00.276508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a5837-28a8-40f0-9ba6-5058ce57bda4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:00.297645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1219/2445] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:27:00.300697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:00.318388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4faea0-436b-48f8-b678-18b0af497c9d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:00.324517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:00.325048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:00.325441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:00.325775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] PATH_INFO: `/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8/users/a327fd8f354b406b948994d94eb4177a/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:00.327801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce41af75d5147a0b739ac47eb8d02b8, user_id=a327fd8f354b406b948994d94eb4177a, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:00.331035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:00.358806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1227/2446] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:27:00 2022] PUT /identity/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8/users/a327fd8f354b406b948994d94eb4177a/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:27:05.112252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661715f0-0208-4963-a1f8-6abf441a0ec5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:05.112844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661715f0-0208-4963-a1f8-6abf441a0ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:05.112938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661715f0-0208-4963-a1f8-6abf441a0ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:05.139953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:05.143540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-661715f0-0208-4963-a1f8-6abf441a0ec5 None None] MFA Rules not processed for user `a327fd8f354b406b948994d94eb4177a`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:05.145410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-661715f0-0208-4963-a1f8-6abf441a0ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:05.250218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1220/2447] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:05.264943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:05.267217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:05.342600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d0a86-56ce-43b6-a7bd-53948c9e9263 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:05.346801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:05.347445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:05.347731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:05.347980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:05.423542 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:05.425194 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:05.438666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1228/2448] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:05.603153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691971-23cc-4a14-8091-b3b211411860 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:05.603868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691971-23cc-4a14-8091-b3b211411860 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:05.604330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691971-23cc-4a14-8091-b3b211411860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:05.635352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-39691971-23cc-4a14-8091-b3b211411860 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:05.636770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-39691971-23cc-4a14-8091-b3b211411860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:05.716585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1221/2449] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:05.726913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:05.729125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:05.767546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:05.841088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dcc61-032b-443d-9e02-e26fd1672d5f service glance] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:05.848847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:05.850740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:05.851035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:05.851421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:05.863480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:05.867642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc001b-2968-47fd-8e33-1f7e6486c980 service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:05.879771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1229/2450] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:07.681958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65d4e-bf86-4f26-b372-fc775372f942 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:07.682614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65d4e-bf86-4f26-b372-fc775372f942 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:07.682614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65d4e-bf86-4f26-b372-fc775372f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:07.703330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f9a65d4e-bf86-4f26-b372-fc775372f942 None None] MFA Rules not processed for user `e7cf1859de244861995386780e46f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:07.704941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f9a65d4e-bf86-4f26-b372-fc775372f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:07.791919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1222/2451] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:15.871443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=22 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:16.136523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:16.136944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:16.137323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:16.159371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] MFA Rules not processed for user `5289d1a0799842e98e6e146fffcc990d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:16.160674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:16.168559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1230/2452] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:17.783156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=78 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:18.798106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:18.798712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:18.798712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:18.822774 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:27:18.824006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:18.834227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1223/2453] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:27:18.851567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:18.870576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669945-40fc-4dc9-97ee-0902dd249fd1 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:18.876193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:18.876965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:18.877396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:18.877769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:18.888016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:18.889690 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:18.901060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1231/2454] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:27:28.815971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:28.895228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=9 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:36.544196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:36.545768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:36.668616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac152-db02-4d46-bcd1-ebc2894e14b6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:36.677540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:36.678280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:36.678654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:36.679172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:36.681178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:36.788943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:36.790628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:36.804984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1224/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:38.642351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:38.653894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c42ca-c5e5-41fd-91ae-efa235cb6beb service swift] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:38.659298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:38.659952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:38.660223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:38.660586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:38.663045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:38.679330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:38.681085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:38.694214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1232/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:40.809777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:40.811444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:40.826485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b668b-2195-4f7c-b879-ffd363783470 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:40.833699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:40.834330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:40.834609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:40.834883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:40.837042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:40.875883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:40.886048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240966-29a0-461b-8f14-99dcad46e694 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:40.890112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:40.890726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:40.891007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:40.891287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:40.893348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:40.914609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:40.916309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:40.929177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1225/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:40.987982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:40.989777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:41.008430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1233/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:27:50.924188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=82 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:50.996072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=34 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:27:52.287963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:52.297875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237ae6-8896-4e8d-a0f8-630f8feb2125 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:52.302649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:52.303274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:52.303574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:52.303837 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:52.313675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:52.315130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:52.325601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1226/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:52.406430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:52.408406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:52.424674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54917-75a1-43b2-b0b6-e3900e5a45cf service glance] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:52.431361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:52.431984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:52.432292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:52.432614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:52.434441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:52.506643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:52.508178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba6ed0-73e6-4fe8-88e2-d35600c55128 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:52.518460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1234/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:27:54.468555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:27:54.470624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:54.482990 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195497-a874-4ed2-876d-5402f648d8c8 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:27:54.487237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:27:54.488068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:27:54.488572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:27:54.489040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:27:54.491490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:27:54.502154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:27:54.503833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:27:54.514922 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1227/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:28:02.513611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=28 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:04.509796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=12 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:06.684518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:06.685235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:06.685235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:06.708480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] MFA Rules not processed for user `45c041b057d14b00b494d275bbdb079d`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:28:06.709711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:06.719427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1235/2462] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:28:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:28:13.279638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:13.325047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745b2f1-e417-49f0-89c3-28cc2fdf3187 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:13.331674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:13.332611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:13.332999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:13.333270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:13.335317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:13.366530 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:13.368139 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d1b04-95fa-4bd6-9fd3-ac90082e3535 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:13.379289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1228/2463] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:28:16.701587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:23.374600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=21 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:04.356891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:04.402162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24180b-98cf-48fb-b193-e1fa991ae55c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:04.406965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:04.407588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:04.407942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:04.408217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:04.410083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:04.433003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:04.434429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059c866-1e2e-4fae-a826-8a6f4ba76dc1 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:04.442650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1236/2464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:05.590283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9dbe0-b022-484c-8ee0-11d09cc2ac7c None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.590956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9dbe0-b022-484c-8ee0-11d09cc2ac7c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.590956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9dbe0-b022-484c-8ee0-11d09cc2ac7c None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.592191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1229/2465] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:29:05.599456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.600030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.600129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.647033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:05.648543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.659012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1237/2466] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:05.675023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9dbe0-b022-484c-8ee0-11d09cc2ac7c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:05.687284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:05.690980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9dbe0-b022-484c-8ee0-11d09cc2ac7c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:05.696037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:05.697191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.697690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.698086 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.710123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:05.710440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a2c09-42fe-4614-85ee-bf35fd31bd26 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:05.713090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e308270-9bca-4aa6-bc26-fa8ab91fad81 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:05.717191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:05.717815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.718234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.718501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.720990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.735160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:05.736730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4899-edca-429e-8a6b-fca173f31b81 service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:05.737258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1230/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:05.757051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1238/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:05.829904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b089-99ff-46fc-9d6e-e98f7bf9f3c6 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.830188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b089-99ff-46fc-9d6e-e98f7bf9f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.830467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342b089-99ff-46fc-9d6e-e98f7bf9f3c6 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.831877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1231/2469] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:29:05.837563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.837911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.838198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.861040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:05.862246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:05.872314 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1239/2470] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:29:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:05.886082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342b089-99ff-46fc-9d6e-e98f7bf9f3c6 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:05.907209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342b089-99ff-46fc-9d6e-e98f7bf9f3c6 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:05.912801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:05.913442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:05.913770 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:05.914003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:05.926786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:05.928251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:05.940766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1232/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:06.017735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:06.019471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:06.106024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527892c0-bb99-4ebf-8c05-f6ed16a9bed9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:06.112265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:06.112927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:06.113204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:06.113474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:06.115311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:06.129686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:06.131615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db758c1d-1466-4f41-960e-519216466e0c service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:06.143001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1240/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:15.934905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=12 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:16.138137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=75 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:20.523162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:20.535519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2382-61e1-40a1-b5b6-239bc27bd2a9 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:20.542238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:20.542888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:20.543124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:20.543388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:20.545357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:20.558158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:20.559755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:20.572558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1233/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:30.565389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:43.112526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa654-94ba-47b1-98b1-85ea6407a3de None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:43.113400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa654-94ba-47b1-98b1-85ea6407a3de None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:43.113400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa654-94ba-47b1-98b1-85ea6407a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:43.140924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0f2fa654-94ba-47b1-98b1-85ea6407a3de None None] MFA Rules not processed for user `e7cf1859de244861995386780e46f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:43.142540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0f2fa654-94ba-47b1-98b1-85ea6407a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:43.152992 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1241/2474] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:29:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:43.662431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:43.680899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb0ec-6987-48ce-9f42-6b69e957e2d2 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:43.699337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:43.700024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:43.700303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:43.700600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:43.705432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:43.718278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:43.720294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:43.731533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1234/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:29:45.112467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:45.113000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:45.113000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:45.133666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] MFA Rules not processed for user `7e552e85d3ba484baf73a5b9dc88764c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:29:45.135109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:45.143204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1242/2476] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:29:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:29:53.726073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:55.127385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=6 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:29:58.267071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:29:58.276494 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ed51-5f62-4b25-9767-018b24fe75b3 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:29:58.280520 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:29:58.281154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:29:58.281435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:29:58.281730 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:29:58.283507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:29:58.386660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:29:58.388074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:29:58.410214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1235/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:30:02.679199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:02.706517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df190069-9239-4187-8bba-9f503ae372d8 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:02.712169 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:02.712913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:02.713191 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:02.713473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:02.715375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:02.728223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:02.729946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:02.741725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1243/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:30:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:30:02.787328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:02.788772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:02.802231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d91a8-5a70-414d-baae-6add23a376de service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:02.809938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:02.810916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:02.811346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:02.811630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] PATH_INFO: `/v3/users/45c041b057d14b00b494d275bbdb079d` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:02.813033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c041b057d14b00b494d275bbdb079d)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:02.814995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:02.870007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c041b057d14b00b494d275bbdb079d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:02.884359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c041b057d14b00b494d275bbdb079d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:02.885241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c041b057d14b00b494d275bbdb079d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:02.892565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c041b057d14b00b494d275bbdb079d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:02.893251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c771b8c9-419c-4d2f-b8d0-771f0cca3eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c041b057d14b00b494d275bbdb079d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:02.908577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1236/2479] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:30:02 2022] DELETE /identity/v3/users/45c041b057d14b00b494d275bbdb079d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:30:03.161625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.174137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f25d-f84a-494f-8f59-f321179c0c83 service placement] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.240385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.241057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.241332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.241605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] PATH_INFO: `/v3/projects/7fcf5b6d03c04c41a795589323962e78` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.242820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcf5b6d03c04c41a795589323962e78)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.244825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.295033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcf5b6d03c04c41a795589323962e78', 'request_id': 'req-224b4338-c65d-43b7-aa18-e9daee9a6c13'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:03.301078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcf5b6d03c04c41a795589323962e78', 'request_id': 'req-224b4338-c65d-43b7-aa18-e9daee9a6c13'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:03.310369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcf5b6d03c04c41a795589323962e78', 'request_id': 'req-224b4338-c65d-43b7-aa18-e9daee9a6c13'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:03.323345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] The token cache is being invalidate because project 7fcf5b6d03c04c41a795589323962e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:30:03.323634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:03.325236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-224b4338-c65d-43b7-aa18-e9daee9a6c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:30:03.327401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1244/2480] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:30:03 2022] DELETE /identity/v3/projects/7fcf5b6d03c04c41a795589323962e78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:30:03.332409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.332722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.333030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.389567 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:03.391008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:03.401348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:03.457128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1237/2481] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:03.465287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae583f-157d-4218-963e-c06a5625017d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.465287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae583f-157d-4218-963e-c06a5625017d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.465712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae583f-157d-4218-963e-c06a5625017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.489055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7cae583f-157d-4218-963e-c06a5625017d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:03.490440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7cae583f-157d-4218-963e-c06a5625017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:03.502451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1245/2482] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:03.507101 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.518401 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7924a8c-d0d8-44f4-b9c6-8870805df441 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.524096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.524755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.525030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.525296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.525955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:30:03.526274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.527942 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.542628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1238/2483] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:30:03.547203 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae583f-157d-4218-963e-c06a5625017d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.557667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae583f-157d-4218-963e-c06a5625017d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.566715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.567349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.567612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.567881 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.568569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.570614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.618237 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1246/2484] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:30:03 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:30:03.619663 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.631415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220dd1-5644-43aa-ab5c-08e64d6aad16 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.700512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.701630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.701914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.702173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.702943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.704950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.733458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1239/2485] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:30:03 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:30:03.734838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.746898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a4fb-94ed-411d-9bf4-5f420fa748f2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.753072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.753772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.754097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.754361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.755097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.756844 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.768240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1247/2486] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:30:03.772658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.783225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5b9e-539b-47fa-9117-c7d93d8c2da4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.788047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.788716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.788997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.789348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.791129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.791601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd6116-05dc-4681-80cc-5ff83735f101 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.804755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1240/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:30:03.808907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.824739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd84bc-acd4-47cf-9311-856ea08e91d6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:03.835674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:03.836040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.836275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.836610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] PATH_INFO: `/v3/projects/a5c4cb6aff084ce8bc482d02e09b607e/users/72e3a754496f407c9f4a063764369a39/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.857676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c4cb6aff084ce8bc482d02e09b607e, user_id=72e3a754496f407c9f4a063764369a39, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:03.860380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:03.877088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1248/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:30:03 2022] PUT /identity/v3/projects/a5c4cb6aff084ce8bc482d02e09b607e/users/72e3a754496f407c9f4a063764369a39/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:30:03.882320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:03.882608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:03.882886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:03.905504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:03.906834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:03.976597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1241/2489] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:03.988683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:03.990859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:03.998125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:04.058543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd5e3-b206-4371-9297-88ff977a5ca9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:04.062825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:04.063466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:04.063868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:04.064138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:04.073667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:04.075233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a46c6-b356-4496-a080-9fffb35b3d1d service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:04.086799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1249/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:30:04.931882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:04.933408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:04.966871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:05.089323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e92fc-2041-40e0-9fef-f221a2d1888a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:05.096705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:05.097336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:05.097636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:05.097956 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:05.099887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:05.114623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:05.116308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:05.128759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1242/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:30:08.794452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde787d6-84b4-48af-bc61-d21a05c4e113 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:08.794972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde787d6-84b4-48af-bc61-d21a05c4e113 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:08.795086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde787d6-84b4-48af-bc61-d21a05c4e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:08.834159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cde787d6-84b4-48af-bc61-d21a05c4e113 None None] MFA Rules not processed for user `72e3a754496f407c9f4a063764369a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:08.838242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cde787d6-84b4-48af-bc61-d21a05c4e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:08.933287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1250/2492] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:08.950555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:30:08.953173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:08.970162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50615ae-a3ff-4df8-b7b7-88f2d7945b69 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:30:08.982263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:30:08.983274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:08.983674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:08.984113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:08.998466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:30:09.001360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:30:09.015338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1243/2493] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:30:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:30:10.511578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9257e9-530e-4dea-8c00-5ab0859a7398 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:30:10.512102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9257e9-530e-4dea-8c00-5ab0859a7398 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:30:10.512102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9257e9-530e-4dea-8c00-5ab0859a7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:30:10.534949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2b9257e9-530e-4dea-8c00-5ab0859a7398 None None] MFA Rules not processed for user `72e3a754496f407c9f4a063764369a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:30:10.536220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2b9257e9-530e-4dea-8c00-5ab0859a7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:30:10.548595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1251/2494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:30:19.010778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=42 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:30:20.527631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=59 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:02.863810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:02.866061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.966795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf1c-0b7f-42a5-b703-14844904b3e2 service nova] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:02.974907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:02.975826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:02.976259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:02.976711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:02.982877 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:02.996256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:02.997928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:03.008968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1244/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:04.440040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.440688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.440688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.461558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:04.462769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:04.522916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1252/2496] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:31:04.573131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:04.575006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:04.651982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ce99a-afa9-4f6c-9d3c-4cae657071cd service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:04.654777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:04.655457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:04.655735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:04.656006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:04.665254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:04.666860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:04.676189 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1245/2497] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:31:06.603762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:06.614940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600bb58-6c50-4ace-9b96-e7e092344434 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:06.620839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:06.621462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:06.621743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:06.622008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:06.623863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:06.700142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:06.701989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:06.712872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1253/2498] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:12.486114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.499834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887542-a9c8-445b-a9b1-a41d58833379 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.510173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.510839 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.511135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.511415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.516693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.533556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.536320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.549674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1246/2499] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:12.561581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.564315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:12.581133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc179c0-e91e-438b-a304-b29e2db6ad8b service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.587295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.588056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.588568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.588846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] PATH_INFO: `/v3/users/5289d1a0799842e98e6e146fffcc990d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.590027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5289d1a0799842e98e6e146fffcc990d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.592001 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:12.650026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5289d1a0799842e98e6e146fffcc990d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.668121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5289d1a0799842e98e6e146fffcc990d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.676694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5289d1a0799842e98e6e146fffcc990d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.677382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5289d1a0799842e98e6e146fffcc990d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.690547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5289d1a0799842e98e6e146fffcc990d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:12.699573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1254/2500] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:12 2022] DELETE /identity/v3/users/5289d1a0799842e98e6e146fffcc990d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:12.877827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:12.894403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046894b2-f6ea-4cd4-a8d1-f2d80852ce2a service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:12.946406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:12.961042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:12.961618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:12.961898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:12.962167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] PATH_INFO: `/v3/projects/26ba525f8fb049a1a15b62a68aa842f5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:12.963313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ba525f8fb049a1a15b62a68aa842f5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:12.965267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.018252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ba525f8fb049a1a15b62a68aa842f5', 'request_id': 'req-c581f45a-8b50-4f6a-9216-03f5f8d5280c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.025891 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ba525f8fb049a1a15b62a68aa842f5', 'request_id': 'req-c581f45a-8b50-4f6a-9216-03f5f8d5280c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.036983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ba525f8fb049a1a15b62a68aa842f5', 'request_id': 'req-c581f45a-8b50-4f6a-9216-03f5f8d5280c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.056427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] The token cache is being invalidate because project 26ba525f8fb049a1a15b62a68aa842f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:13.056739 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.057482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.059094 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1247/2501] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:12 2022] DELETE /identity/v3/projects/26ba525f8fb049a1a15b62a68aa842f5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:13.063206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.064837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.080834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e600221-0c52-4184-af8c-641867231b39 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.099234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:13.152698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.153470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.153632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.153872 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] PATH_INFO: `/v3/users/a327fd8f354b406b948994d94eb4177a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.155038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a327fd8f354b406b948994d94eb4177a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.158569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.215614 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a327fd8f354b406b948994d94eb4177a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.224998 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a327fd8f354b406b948994d94eb4177a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.233278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a327fd8f354b406b948994d94eb4177a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.234029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a327fd8f354b406b948994d94eb4177a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.250258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a327fd8f354b406b948994d94eb4177a'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.257327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1255/2502] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:13 2022] DELETE /identity/v3/users/a327fd8f354b406b948994d94eb4177a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:13.324367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.325857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.392860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f45a-8b50-4f6a-9216-03f5f8d5280c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.444987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.445791 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.445920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.446336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.448050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.473762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:13.475657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:13.506066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:13.527807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.529212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.541369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1248/2503] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:31:13.565730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270d679-39b1-4916-b82b-26710211060d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:13.570608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:13.571272 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:13.571552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:13.571822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] PATH_INFO: `/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:13.573002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce41af75d5147a0b739ac47eb8d02b8)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:13.575027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:13.619223 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:13.631787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce41af75d5147a0b739ac47eb8d02b8', 'request_id': 'req-940a7760-8753-4e25-9a5c-307598a62fb5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.637558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce41af75d5147a0b739ac47eb8d02b8', 'request_id': 'req-940a7760-8753-4e25-9a5c-307598a62fb5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.647610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce41af75d5147a0b739ac47eb8d02b8', 'request_id': 'req-940a7760-8753-4e25-9a5c-307598a62fb5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.660379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] The token cache is being invalidate because project 4ce41af75d5147a0b739ac47eb8d02b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:13.660737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.661370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:13.663336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1256/2504] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:13 2022] DELETE /identity/v3/projects/4ce41af75d5147a0b739ac47eb8d02b8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:19.960341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:19.965981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:19.978750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb93d9-a9aa-4aa4-afdb-df6121b3e319 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.038113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.038749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.039032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.039286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] PATH_INFO: `/v3/users/5e8bbcb87073485aa05ae5813e0af779` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.040500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8bbcb87073485aa05ae5813e0af779)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.042491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.095499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8bbcb87073485aa05ae5813e0af779'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.108558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8bbcb87073485aa05ae5813e0af779'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.109377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8bbcb87073485aa05ae5813e0af779'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.116643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8bbcb87073485aa05ae5813e0af779'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.117310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8bbcb87073485aa05ae5813e0af779'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.131246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1249/2505] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:19 2022] DELETE /identity/v3/users/5e8bbcb87073485aa05ae5813e0af779 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.345005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.346473 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.361057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a7760-8753-4e25-9a5c-307598a62fb5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.439122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.439736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.440107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.440460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] PATH_INFO: `/v3/projects/2d826dcf541043eaa1ca4204af2093d6` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.442148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d826dcf541043eaa1ca4204af2093d6)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.445220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.503640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d826dcf541043eaa1ca4204af2093d6', 'request_id': 'req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.509568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d826dcf541043eaa1ca4204af2093d6', 'request_id': 'req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.518942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d826dcf541043eaa1ca4204af2093d6', 'request_id': 'req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.532026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] The token cache is being invalidate because project 2d826dcf541043eaa1ca4204af2093d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:20.532344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.533102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.534931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1257/2506] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/projects/2d826dcf541043eaa1ca4204af2093d6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.538910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.540475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.554459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec151-5505-47a4-a6df-b2d214431fb9 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.619344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:20.619994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:20.620271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:20.620581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] PATH_INFO: `/v3/users/0df221ddc0e74b42afa0893371200402` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:20.621744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df221ddc0e74b42afa0893371200402)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:20.623692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:20.626339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:20.677004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df221ddc0e74b42afa0893371200402'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.689700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df221ddc0e74b42afa0893371200402'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.690345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df221ddc0e74b42afa0893371200402'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.697609 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df221ddc0e74b42afa0893371200402'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.698164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-db2b8d00-3d30-4cb8-a69d-afc5102d3171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df221ddc0e74b42afa0893371200402'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:20.713490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1250/2507] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/users/0df221ddc0e74b42afa0893371200402 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:20.917400 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:31:20.918995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:20.934173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa186-c4cd-4c0a-bfca-f458992e0ae9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:31:20.993719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:21.003678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:31:21.004370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:21.004805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:21.005200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] PATH_INFO: `/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:21.006577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cb02ee0c3a4e2088dd17b3e2b93732)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:31:21.008644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:31:21.065588 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cb02ee0c3a4e2088dd17b3e2b93732', 'request_id': 'req-f5e9dff8-80f5-4659-87b0-52478880f476'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.071323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cb02ee0c3a4e2088dd17b3e2b93732', 'request_id': 'req-f5e9dff8-80f5-4659-87b0-52478880f476'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.082819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cb02ee0c3a4e2088dd17b3e2b93732', 'request_id': 'req-f5e9dff8-80f5-4659-87b0-52478880f476'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.094632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] The token cache is being invalidate because project 10cb02ee0c3a4e2088dd17b3e2b93732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:31:21.094918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.095610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:31:21.097165 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1258/2508] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:31:20 2022] DELETE /identity/v3/projects/10cb02ee0c3a4e2088dd17b3e2b93732 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:31:30.709841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:31.091392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:31:58.936529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:31:58.937089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:31:58.937274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:31:58.958964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] MFA Rules not processed for user `e7cf1859de244861995386780e46f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:31:58.960198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:31:59.037779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1251/2509] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:00.921757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:00.923329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:00.997307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9dff8-80f5-4659-87b0-52478880f476 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:01.001531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:01.002160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:01.002454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:01.002749 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:01.004695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:01.079792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:01.081217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:01.091883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1259/2510] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:04.670181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:04.671860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:04.702199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552218b-e3f8-458a-a8e0-5c436431e99c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:04.709473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:04.710200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:04.710522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:04.711050 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] PATH_INFO: `/v3/users/7e552e85d3ba484baf73a5b9dc88764c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:04.713078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e552e85d3ba484baf73a5b9dc88764c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:04.715534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:04.772256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e552e85d3ba484baf73a5b9dc88764c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.788312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e552e85d3ba484baf73a5b9dc88764c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.792987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e552e85d3ba484baf73a5b9dc88764c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.802089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e552e85d3ba484baf73a5b9dc88764c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.803109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-1fcb3fa7-d41a-4ae2-abfd-94fc87eecad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e552e85d3ba484baf73a5b9dc88764c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:04.818062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1252/2511] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:04 2022] DELETE /identity/v3/users/7e552e85d3ba484baf73a5b9dc88764c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:05.003672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.018710 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b141-343b-4b95-8274-5ae61ac986ab service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.089761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.090392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.090668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.090934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] PATH_INFO: `/v3/projects/a34cad2b6a8742cbae2a54b0826e69af` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.092497 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34cad2b6a8742cbae2a54b0826e69af)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.094580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.148547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34cad2b6a8742cbae2a54b0826e69af', 'request_id': 'req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.150678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.155622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34cad2b6a8742cbae2a54b0826e69af', 'request_id': 'req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.164839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34cad2b6a8742cbae2a54b0826e69af', 'request_id': 'req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.180105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] The token cache is being invalidate because project a34cad2b6a8742cbae2a54b0826e69af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:05.180446 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.181311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2b5fb0c9-0b10-492f-9c90-5cfd78eebd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:05.183395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1260/2512] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:05 2022] DELETE /identity/v3/projects/a34cad2b6a8742cbae2a54b0826e69af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:05.189423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.189816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.190230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.219827 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:05.221150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.297258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1253/2513] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:05.306959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.307691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.307983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.329839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:05.331148 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.342663 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1261/2514] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:05.347271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.358812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c8083-c93b-465c-a3cf-accec6d63830 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.363921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.366044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.366044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.366044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.366044 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:05.366436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.367852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.381858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1254/2515] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:05.388375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.399470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05dec9-23db-4bd5-b7ca-bac833104829 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.406532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.407832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.407832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.407832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.408344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.410284 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.441848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1262/2516] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:05.446424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.454448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:05.458534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066fa89-4fa3-4e98-8016-dbd873d532eb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.518802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.519416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.519690 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.519955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.520632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.522563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.548004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1255/2517] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:05.552456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.564188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66f80-a7f2-440d-bbfe-f7e511ed68da admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.569324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.569941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.570217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.570483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.571141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.572853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.585350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1263/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:05.589638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.607606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b6e9-10fc-4c22-b816-5a8da8ebc40d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.615016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.615721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.616040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.616364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.617117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.618923 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9334eb-d0b1-4122-afe3-acf3694bfcaa admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.634344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1256/2519] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:05.638469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.649728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4da8a-679c-46cc-8509-d43e0a79f4f6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.654639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.655324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.655601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.656234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] PATH_INFO: `/v3/projects/8ddf3be228494e6692440af3a681687c/users/45d6937125db4916995f4a0e24428eeb/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.674144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddf3be228494e6692440af3a681687c, user_id=45d6937125db4916995f4a0e24428eeb, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.676906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.693294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1264/2520] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:05 2022] PUT /identity/v3/projects/8ddf3be228494e6692440af3a681687c/users/45d6937125db4916995f4a0e24428eeb/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:05.706143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.706732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.706732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.745168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] MFA Rules not processed for user `45d6937125db4916995f4a0e24428eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:05.746919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.832514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1257/2521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:05.844777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:05.847025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:05.938049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab2058-add9-4052-9f01-8d1312d197cc admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:05.944911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:05.946101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:05.946101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:05.946326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:05.966002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:05.967046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6c102-d398-4447-a054-83d3cd1d99cb service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:05.986986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1265/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:06.262722 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.351275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45b6b8-338c-4780-bfa0-c903e2e568aa None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.356068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.356763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.357043 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.357338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] PATH_INFO: `/v3/users/45d6937125db4916995f4a0e24428eeb` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.358608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d6937125db4916995f4a0e24428eeb)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.361455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.376803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:06.424964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d6937125db4916995f4a0e24428eeb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.449597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d6937125db4916995f4a0e24428eeb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.450574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d6937125db4916995f4a0e24428eeb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.460943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d6937125db4916995f4a0e24428eeb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.462103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d6937125db4916995f4a0e24428eeb'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:06.481015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1258/2523] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:06 2022] DELETE /identity/v3/users/45d6937125db4916995f4a0e24428eeb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:06.485139 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.486111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.486448 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.511153 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:06.513214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.615704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1266/2524] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:06.628737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:06.630491 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:06.717928 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3ffc9-3e21-4ed7-9ecd-42b081eeb4ab admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:06.722195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:06.722828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:06.723118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:06.723380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:06.737426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:06.740966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b342b2-d948-4c97-a8ac-d7d260e022c6 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:06.760029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1259/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:07.364494 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.366796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.377082 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.384948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9d615-610b-49a9-90f7-732e89deeed6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.393220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.393885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.395116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.395407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] PATH_INFO: `/v3/projects/8ddf3be228494e6692440af3a681687c` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.397123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddf3be228494e6692440af3a681687c)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.399794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.457021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddf3be228494e6692440af3a681687c', 'request_id': 'req-3d4c525c-d1fb-41f7-9591-012fbc108da6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.463357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddf3be228494e6692440af3a681687c', 'request_id': 'req-3d4c525c-d1fb-41f7-9591-012fbc108da6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.471906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddf3be228494e6692440af3a681687c', 'request_id': 'req-3d4c525c-d1fb-41f7-9591-012fbc108da6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.487286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] The token cache is being invalidate because project 8ddf3be228494e6692440af3a681687c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:07.487987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.488317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3d4c525c-d1fb-41f7-9591-012fbc108da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:07.490064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1267/2526] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:07 2022] DELETE /identity/v3/projects/8ddf3be228494e6692440af3a681687c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.495274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.495615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.495878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.517405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:07.518652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.589160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1260/2527] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:07.598428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.598812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.599144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.620706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:07.621842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:07.630603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1268/2528] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:07.635496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.646430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a5323-3887-4bac-b63c-5d47e388e2e5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.652516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.652516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.652866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.652866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.653489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:07.653972 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.655763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.672950 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1261/2529] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:07.674957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.686214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b60b-5fa5-4ede-bf1b-fdfa441f6240 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.691643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.692344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.692691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.693038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.693770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.695910 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.728576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1269/2530] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:07.733655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.744856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c548-0d95-40cf-8ea2-be3fd8c802ca admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.771862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:07.815582 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.816205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.816513 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.816790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.817429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.819369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.846604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1262/2531] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:07.848208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.859193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3854-bbc6-48c6-ad6d-279d094258b5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.864036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.864693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.864974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.865247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.865900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.867512 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.878801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1270/2532] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:07.883433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.898416 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d83a8-b3ca-4390-9861-65e269accb15 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.906358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.906974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.907257 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.907528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.908181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.909829 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c7d9b-6325-4169-8026-8de5d70812ba admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.921613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1263/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:07.926078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:07.936706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f2060-65c4-4209-9db8-62d119002d21 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:07.942921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:07.943555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.943825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.944086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] PATH_INFO: `/v3/projects/34a87a8b5782418c9c1e3731b852098f/users/1d874948be1949c6a2a1e8f5a3ca3543/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:07.960712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a87a8b5782418c9c1e3731b852098f, user_id=1d874948be1949c6a2a1e8f5a3ca3543, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:07.963339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:07.978143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1271/2534] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:07 2022] PUT /identity/v3/projects/34a87a8b5782418c9c1e3731b852098f/users/1d874948be1949c6a2a1e8f5a3ca3543/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:07.983422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaddfd-e39e-45c9-bc86-366ef23990c0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:07.983710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaddfd-e39e-45c9-bc86-366ef23990c0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:07.984009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaddfd-e39e-45c9-bc86-366ef23990c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.007350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cbfaddfd-e39e-45c9-bc86-366ef23990c0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.008620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cbfaddfd-e39e-45c9-bc86-366ef23990c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.074423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1264/2535] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:08.084726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:08.086462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:08.146302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b674f-d1a8-4043-be3e-7e5c375710c5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:08.150466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:08.151084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.151347 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.151610 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.162691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:08.164167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:08.175750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1272/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:08.875620 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:08.876299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:08.876299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:08.915269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] MFA Rules not processed for user `1d874948be1949c6a2a1e8f5a3ca3543`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:08.916884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:09.018823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1265/2537] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:09.023965 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.037772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85536b-062a-46a6-896a-82529b33a3b5 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.046555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.048105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.048517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.048877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.049627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.052051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.088784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1273/2538] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:09.090445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.102642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c060e-09fe-4c33-a347-3229ae6d4eff None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.134695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:09.165413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.166033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.166343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.166712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.167295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.169323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.193415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1266/2539] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:09 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:09.197562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.204624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:09.210508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c54077-f2a1-4b84-a1d3-f4ad5d3efc3c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.216772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.217547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.217991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.218305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.219229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.220784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.232118 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1274/2540] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:09.238591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.250470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55bee-d615-4310-818e-59bdfbd72d22 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.256334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.257153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.257433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.257853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] PATH_INFO: `/v3/projects/d0cbe1be874e41858bc7187862d34253/users/eefb5748a76e4b339b63b1daa9358ad0/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.282289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cbe1be874e41858bc7187862d34253, user_id=eefb5748a76e4b339b63b1daa9358ad0, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.285541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.303053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1267/2541] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:09 2022] PUT /identity/v3/projects/d0cbe1be874e41858bc7187862d34253/users/eefb5748a76e4b339b63b1daa9358ad0/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:09.307114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.319183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9d3e2-716b-4d56-9ecb-4934bcf84e5f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.382936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.383546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.383821 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.384087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.385114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.387541 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e23d92-2e66-40a4-9f00-1f5823716f85 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.402508 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1275/2542] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:09.408857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:09.420283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720928-b037-4704-b75c-06a0aa9084b1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:09.425995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:09.426701 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:09.426999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:09.427272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] PATH_INFO: `/v3/projects/d0cbe1be874e41858bc7187862d34253/users/eefb5748a76e4b339b63b1daa9358ad0/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:09.429359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cbe1be874e41858bc7187862d34253, user_id=eefb5748a76e4b339b63b1daa9358ad0, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:09.432016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:09.444412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1268/2543] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:09 2022] PUT /identity/v3/projects/d0cbe1be874e41858bc7187862d34253/users/eefb5748a76e4b339b63b1daa9358ad0/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:10.488753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:10.489341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:10.489341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:10.521883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] MFA Rules not processed for user `eefb5748a76e4b339b63b1daa9358ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:10.523122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:10.606414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1276/2544] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:11.868521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:11.940445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c58a8-bf35-4f60-9eff-e3641d37fc46 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:11.947115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:11.947802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:11.948100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:11.948421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] PATH_INFO: `/v3/users/1d874948be1949c6a2a1e8f5a3ca3543` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:11.949772 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d874948be1949c6a2a1e8f5a3ca3543)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:11.951880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.007360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d874948be1949c6a2a1e8f5a3ca3543'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.020822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d874948be1949c6a2a1e8f5a3ca3543'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.021584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d874948be1949c6a2a1e8f5a3ca3543'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.029029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d874948be1949c6a2a1e8f5a3ca3543'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.029744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d874948be1949c6a2a1e8f5a3ca3543'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.044658 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1269/2545] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:11 2022] DELETE /identity/v3/users/1d874948be1949c6a2a1e8f5a3ca3543 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.235243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.246907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b41154-4506-43ce-8bc8-482c545b97fd None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.313059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.313606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.313878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.314141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] PATH_INFO: `/v3/projects/34a87a8b5782418c9c1e3731b852098f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.315413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a87a8b5782418c9c1e3731b852098f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.317417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.338205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.382763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a87a8b5782418c9c1e3731b852098f', 'request_id': 'req-3e8e50da-5b41-462d-8894-7b40de8eb6e5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.388728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a87a8b5782418c9c1e3731b852098f', 'request_id': 'req-3e8e50da-5b41-462d-8894-7b40de8eb6e5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.397924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a87a8b5782418c9c1e3731b852098f', 'request_id': 'req-3e8e50da-5b41-462d-8894-7b40de8eb6e5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.412231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] The token cache is being invalidate because project 34a87a8b5782418c9c1e3731b852098f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:12.412655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.413376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.415209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1277/2546] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:12 2022] DELETE /identity/v3/projects/34a87a8b5782418c9c1e3731b852098f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.420032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.422033 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.432668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:12.441272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5308f-5b7e-4fd5-abd3-3c85fd567990 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.515293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.516075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.516378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.516698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] PATH_INFO: `/v3/users/eefb5748a76e4b339b63b1daa9358ad0` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.518242 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eefb5748a76e4b339b63b1daa9358ad0)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.520749 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:12.574507 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eefb5748a76e4b339b63b1daa9358ad0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.590314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eefb5748a76e4b339b63b1daa9358ad0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.591055 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eefb5748a76e4b339b63b1daa9358ad0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.601309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eefb5748a76e4b339b63b1daa9358ad0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.602307 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2f714d6f-021b-422f-ac42-759f902435f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eefb5748a76e4b339b63b1daa9358ad0'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:12.620054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1270/2547] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:12 2022] DELETE /identity/v3/users/eefb5748a76e4b339b63b1daa9358ad0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:12.848074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:12.850304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:12.877762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e50da-5b41-462d-8894-7b40de8eb6e5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:12.957557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:12.960188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:12.960188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:12.960188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] PATH_INFO: `/v3/projects/d0cbe1be874e41858bc7187862d34253` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:12.960188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cbe1be874e41858bc7187862d34253)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:12.961897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.035503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cbe1be874e41858bc7187862d34253', 'request_id': 'req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.042080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cbe1be874e41858bc7187862d34253', 'request_id': 'req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.055160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cbe1be874e41858bc7187862d34253', 'request_id': 'req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.069026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] The token cache is being invalidate because project d0cbe1be874e41858bc7187862d34253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:13.069403 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.070013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b1a50095-7d78-4a6d-b009-fdfed8bc06fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:13.071739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1278/2548] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:12 2022] DELETE /identity/v3/projects/d0cbe1be874e41858bc7187862d34253 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:13.077198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.077916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.077916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.102876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:13.104145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.194427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1271/2549] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:13.205002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.205687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.206212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.238243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:13.239475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.248249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1279/2550] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:13.252914 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.267358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162ce5-951d-4921-bb69-c8e926f18774 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.273224 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.273650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.273815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.274076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.274692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:13.274992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.276642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.295091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1272/2551] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:13.300179 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.312026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12604c55-e004-4c44-95ec-6e8544f04a7b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.319158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.319789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.320066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.320332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.321028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.323110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.358940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1280/2552] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:13.362849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.383831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3babd6f-b118-4dc4-887b-69696924b1c8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.410654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:13.474183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.474793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.475068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.475349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.475997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.477930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.502078 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1273/2553] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:13.506358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.513096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:13.517116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687da930-92c0-434d-94ed-fcc6c481cd5f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.524406 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.525096 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.525289 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.526107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.526836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.529078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.540114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1281/2554] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:13.544818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.556191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3cbdd-1bf5-4ae2-92ff-ed976038a6bb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.561688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.562430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.562852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.563277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.564314 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.566279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92a0f7-bbbe-4012-8d16-9daba07daaca admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.578358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1274/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:13.582906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.594008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e78ef-8453-46ba-a2af-b6b09b3b43e3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.600977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.601654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.601958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.602294 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] PATH_INFO: `/v3/projects/0e2308e2b7ec47a5bfc6b79241aa6c86/users/91c4dd015801461d9f1a9dbfc12187a6/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.620177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2308e2b7ec47a5bfc6b79241aa6c86, user_id=91c4dd015801461d9f1a9dbfc12187a6, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.623138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.639962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1282/2556] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:13 2022] PUT /identity/v3/projects/0e2308e2b7ec47a5bfc6b79241aa6c86/users/91c4dd015801461d9f1a9dbfc12187a6/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:13.651088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.651373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.651638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.683463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] MFA Rules not processed for user `91c4dd015801461d9f1a9dbfc12187a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:13.684742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:13.761531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1275/2557] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:13.766847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.840657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ead1-fc2d-47e0-93db-7319fa0577a7 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.847704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.848335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.848637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.848875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.849562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.851525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:13.881334 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1283/2558] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:13.886587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:13.899801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c60e2-7325-4abf-9df0-34e2c16af470 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:13.980864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:13.981504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:13.981876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:13.982114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:13.982785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:13.984960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.009882 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1276/2559] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:13 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:14.015847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.029794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fbbb8-44a1-42a4-8b2b-2d5d7e1274ed admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.035488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.036090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.036372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.036667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.037433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.038968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.052640 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1284/2560] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:14.057271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.070361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae9f7-5ced-4033-b68a-a96c66bc3adb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.076310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.077028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.077351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.078337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] PATH_INFO: `/v3/projects/ed0d6220baab440eb2349935e7d4f73d/users/0f44ab29d6ab48ff902f073bff48d54e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.081153 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:14.099359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0d6220baab440eb2349935e7d4f73d, user_id=0f44ab29d6ab48ff902f073bff48d54e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.102090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.117799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1277/2561] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:14 2022] PUT /identity/v3/projects/ed0d6220baab440eb2349935e7d4f73d/users/0f44ab29d6ab48ff902f073bff48d54e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:14.122660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.134216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3009ad9-3c25-49c3-84bb-8c92f6b81497 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.199171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.199782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.200055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.200322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.201070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.202670 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69799-1ac4-4c60-9557-0717c6d548c5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.214625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1285/2562] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:14.219618 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.233006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6d78-7482-4e8b-969c-660bf06a959d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.239823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.240532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.240816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.241093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] PATH_INFO: `/v3/projects/ed0d6220baab440eb2349935e7d4f73d/users/0f44ab29d6ab48ff902f073bff48d54e/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.243446 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0d6220baab440eb2349935e7d4f73d, user_id=0f44ab29d6ab48ff902f073bff48d54e, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.246264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.257447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1278/2563] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:14 2022] PUT /identity/v3/projects/ed0d6220baab440eb2349935e7d4f73d/users/0f44ab29d6ab48ff902f073bff48d54e/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:14.270729 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.271308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.271440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.310365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] MFA Rules not processed for user `0f44ab29d6ab48ff902f073bff48d54e`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:14.311559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.346087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:14.398250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1286/2564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:14.412008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.414235 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.513352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e215-e4bc-47b1-8132-16bf9fb98f9d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.520056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.520888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.521136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.521450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.534600 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.536838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046115-0f9a-4b92-9cc9-98047cdac4e9 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.549855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1279/2565] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:14.603362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:14.604867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:14.618137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390550-8e4a-4b5a-9104-cf312e6830bb None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:14.621970 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:14.622572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:14.622840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:14.623098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:14.685119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:14.686571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:14.697723 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1287/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:17.739844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:17.740836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:17.741304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:17.775836 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:17.777951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:17.885223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1280/2567] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:17.950250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:17.951861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:18.067914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4e02-850e-4385-bd68-ad7e781b4656 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.081698 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.081953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.082188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.082296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.102073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.103892 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632802f-9283-478e-81de-7bb75c490992 service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.117333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1288/2568] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:32:18.618275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:18.751944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:18.762299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf3751-9a0d-45e3-b34d-2047861e39a2 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:18.773974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:18.774653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.774964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.775219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] PATH_INFO: `/v3/users/91c4dd015801461d9f1a9dbfc12187a6` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.776419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c4dd015801461d9f1a9dbfc12187a6)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:18.778581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:18.862685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c4dd015801461d9f1a9dbfc12187a6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.902013 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c4dd015801461d9f1a9dbfc12187a6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.903332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c4dd015801461d9f1a9dbfc12187a6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.919960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c4dd015801461d9f1a9dbfc12187a6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.920873 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c4dd015801461d9f1a9dbfc12187a6'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:18.952633 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1281/2569] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:18 2022] DELETE /identity/v3/users/91c4dd015801461d9f1a9dbfc12187a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:18.957955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:18.959315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:18.959962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:18.995696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:18.998596 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.069455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=100 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:19.095093 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1289/2570] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:19.105901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.108135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.206306 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080ca6b-72fd-4d54-bd1f-903e364efcab admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.213925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.214788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.215267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.215604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.231623 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.234020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.247799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1282/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:19.598303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.599846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:19.629810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109d183-e1f4-4340-9ef5-7f11b1a42adc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.644098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.644098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.644098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.644098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] PATH_INFO: `/v3/projects/0e2308e2b7ec47a5bfc6b79241aa6c86` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.648693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2308e2b7ec47a5bfc6b79241aa6c86)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.650778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.764030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2308e2b7ec47a5bfc6b79241aa6c86', 'request_id': 'req-bdbe3643-2cf3-4153-bef5-a0416518a813'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.772170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2308e2b7ec47a5bfc6b79241aa6c86', 'request_id': 'req-bdbe3643-2cf3-4153-bef5-a0416518a813'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.782520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2308e2b7ec47a5bfc6b79241aa6c86', 'request_id': 'req-bdbe3643-2cf3-4153-bef5-a0416518a813'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.796861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] The token cache is being invalidate because project 0e2308e2b7ec47a5bfc6b79241aa6c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:19.797236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.797956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.799880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1290/2572] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:19 2022] DELETE /identity/v3/projects/0e2308e2b7ec47a5bfc6b79241aa6c86 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:19.804968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:19.819606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dde95-82f1-4aa5-abde-8e59d0fa68c8 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:19.887684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:19.888557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:19.888842 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:19.889133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] PATH_INFO: `/v3/users/0f44ab29d6ab48ff902f073bff48d54e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:19.890485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f44ab29d6ab48ff902f073bff48d54e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:19.893250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:19.924124 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:19.960324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f44ab29d6ab48ff902f073bff48d54e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.980785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f44ab29d6ab48ff902f073bff48d54e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.981931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f44ab29d6ab48ff902f073bff48d54e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.996565 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f44ab29d6ab48ff902f073bff48d54e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:19.998022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7012e253-6b5f-442f-bbe7-76f4966eb9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f44ab29d6ab48ff902f073bff48d54e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.016682 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1283/2573] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:19 2022] DELETE /identity/v3/users/0f44ab29d6ab48ff902f073bff48d54e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:20.391149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.392688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.406684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe3643-2cf3-4153-bef5-a0416518a813 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.481109 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.481928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.482282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.482639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] PATH_INFO: `/v3/projects/ed0d6220baab440eb2349935e7d4f73d` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.483899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0d6220baab440eb2349935e7d4f73d)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.486095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.559421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0d6220baab440eb2349935e7d4f73d', 'request_id': 'req-db61bc08-d572-4118-9064-1b10dd25ed7d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.567263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0d6220baab440eb2349935e7d4f73d', 'request_id': 'req-db61bc08-d572-4118-9064-1b10dd25ed7d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.579551 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0d6220baab440eb2349935e7d4f73d', 'request_id': 'req-db61bc08-d572-4118-9064-1b10dd25ed7d'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.593854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] The token cache is being invalidate because project ed0d6220baab440eb2349935e7d4f73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:20.594398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.595344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-db61bc08-d572-4118-9064-1b10dd25ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:20.597755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1291/2574] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:20 2022] DELETE /identity/v3/projects/ed0d6220baab440eb2349935e7d4f73d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:20.602915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.603208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.603525 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.628302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:20.630367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.718904 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1284/2575] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:20.728256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.728825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.729170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.754776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:20.762053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:20.764458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:20.786929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1292/2576] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:20.791971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.811589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539a950-9874-4dd8-bef3-432b2cc668d1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.820115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.821247 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.821738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.822109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.822868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:20.823320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.825072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.844797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1285/2577] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:32:20.848814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.862397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32b70a-34f7-4d15-b2ba-f47f0c520eba None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:20.871222 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:20.871878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:20.872155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:20.872560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:20.873531 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:20.876511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:20.923304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1293/2578] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:20.924411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:20.940522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f54ee9-fe90-4173-9225-03a16be2d6e4 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.026504 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.027334 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.027706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.028017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.028814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.031128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.070028 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1286/2579] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:20 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:21.071159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.085041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6afde-8478-49b0-9b68-12e3461ce1cc admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.090642 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.091454 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.091832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.092319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.093113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.095183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.106552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1294/2580] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.113260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.123954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b289c-4895-4871-956a-1c75b1c24b0c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.131439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.131439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.131439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.131439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.131930 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.132411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a763f5-62bc-4fbd-981f-4dab3319f20c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.148696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1287/2581] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.150016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.161417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4049-2271-4613-8fba-83134d341472 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.167943 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.168739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.169288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.169737 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] PATH_INFO: `/v3/projects/b35f158acc604ad2a799512336ab8331/users/e14c7fc46de64c1e89a1c95e12fdd277/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.189173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35f158acc604ad2a799512336ab8331, user_id=e14c7fc46de64c1e89a1c95e12fdd277, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.192100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.220760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1295/2582] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:21 2022] PUT /identity/v3/projects/b35f158acc604ad2a799512336ab8331/users/e14c7fc46de64c1e89a1c95e12fdd277/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.230015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.230645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.230982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.242619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:21.271423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] MFA Rules not processed for user `e14c7fc46de64c1e89a1c95e12fdd277`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:21.272792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.372522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1288/2583] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:21.377725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.476040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de260-be2a-4eef-9f46-8bfa233fa720 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.481417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.482038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.482315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.482585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.483245 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.485329 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.522298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1296/2584] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:21.525929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.540366 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab770-ad2e-440c-8dc1-cf95b2aac84d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.617199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.617902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.618184 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.618454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.619164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.621196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.649903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1289/2585] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:21.654308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.670919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f818f-62b2-411e-97da-b913ec92807d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.678648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.679579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.679902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.680348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.681322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.683771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.698183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1297/2586] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.702419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.716854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f5a7-9647-453c-9118-bcae1f69b7ba admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.732090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.732897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.733179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.733578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.734568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.737450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1616659-f463-431d-b204-89349436dcfb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.754973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1290/2587] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:21.755783 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:21.770258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd36415-deb0-41e7-8a63-01ece488a218 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:21.776198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:21.776996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.777268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.777802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] PATH_INFO: `/v3/projects/c8c3501d40c246df8b53d6ef338cda7a/users/f86ad4ca4add432e8e06aeefab21ab9b/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.800540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c3501d40c246df8b53d6ef338cda7a, user_id=f86ad4ca4add432e8e06aeefab21ab9b, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:21.803513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:21.830503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1298/2588] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:21 2022] PUT /identity/v3/projects/c8c3501d40c246df8b53d6ef338cda7a/users/f86ad4ca4add432e8e06aeefab21ab9b/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:21.832693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:21.833631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:21.833907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:21.868109 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] MFA Rules not processed for user `f86ad4ca4add432e8e06aeefab21ab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:21.869676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:21.942603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1291/2589] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:21.947357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.022630 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.044200 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e12f-5a2a-411a-8c2b-043c459f3a1f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.051385 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.052335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.052889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.053384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.054264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.056649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.094757 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1299/2590] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:21 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:22.099262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.107765 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:22.120174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dcc88-5a44-4329-94dd-e5910ff755aa None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.228133 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.229298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.230313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.230748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.232229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.235703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.270262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1292/2591] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:22.274180 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.287919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a479f0-8b1b-45b1-a181-552af0b4fe71 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.294676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.295449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.295816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.296458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.297293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.299271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.315456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1300/2592] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:22.320279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.333427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfa6a-624b-4b68-80d5-83c9a7e8fb2a admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.342953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.344204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.344204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.345687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] PATH_INFO: `/v3/projects/dacf606c53a541efadd950db0d82879b/users/2681c3b6a7154b2cb20bab06e34331fd/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.380343 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacf606c53a541efadd950db0d82879b, user_id=2681c3b6a7154b2cb20bab06e34331fd, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.389192 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.422720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1293/2593] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:22 2022] PUT /identity/v3/projects/dacf606c53a541efadd950db0d82879b/users/2681c3b6a7154b2cb20bab06e34331fd/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:22.427627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.440619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c94f2-0f39-4812-9af9-98c300250d78 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.528444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.529461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.529799 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.530129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.530901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.534260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22419c3-8713-409b-95c3-29c4c1cc1521 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.546884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1301/2594] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:22.553612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.570886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fcbb-60fe-49ac-b86f-062df58062ec admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.579206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.580330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.580862 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.581350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] PATH_INFO: `/v3/projects/dacf606c53a541efadd950db0d82879b/users/2681c3b6a7154b2cb20bab06e34331fd/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.584323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacf606c53a541efadd950db0d82879b, user_id=2681c3b6a7154b2cb20bab06e34331fd, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.589592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.606130 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1294/2595] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:22 2022] PUT /identity/v3/projects/dacf606c53a541efadd950db0d82879b/users/2681c3b6a7154b2cb20bab06e34331fd/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:22.617022 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.617393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.617731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.655566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] MFA Rules not processed for user `2681c3b6a7154b2cb20bab06e34331fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:22.657643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.763923 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1302/2596] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:22.775949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.777790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.858406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a30bc-ecb0-49ef-ae02-8c392ab2da52 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.862943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.863578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.863857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.864128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:22.876584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:22.878126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:22.890712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1295/2597] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:22.942112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:22.943650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:22.971411 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ab64-ace0-4ea3-8843-7f50b75a493b None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:22.983413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:22.983413 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:22.983735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:22.984035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:23.055979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:23.077155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:23.079376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517744-55f6-426e-b189-ddb534088a05 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:23.090312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1303/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:26.286427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.361336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:26.369443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521bce-0c04-4c89-b81c-4e3e6dc529d0 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.375590 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.376413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.376778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.377179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] PATH_INFO: `/v3/users/e14c7fc46de64c1e89a1c95e12fdd277` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.378615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14c7fc46de64c1e89a1c95e12fdd277)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.380864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.443337 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14c7fc46de64c1e89a1c95e12fdd277'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.465376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14c7fc46de64c1e89a1c95e12fdd277'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.466336 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14c7fc46de64c1e89a1c95e12fdd277'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.478015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14c7fc46de64c1e89a1c95e12fdd277'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.478883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14c7fc46de64c1e89a1c95e12fdd277'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:26.501982 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1296/2599] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:26 2022] DELETE /identity/v3/users/e14c7fc46de64c1e89a1c95e12fdd277 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:26.508978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.509890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.510431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.542017 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:26.543709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.619367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1304/2600] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:26.630541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:26.632592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:26.715473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d13b1-e92c-469c-9d80-e5e8d85543bf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:26.721818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:26.722556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:26.723059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:26.723404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:26.737887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:26.740282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:26.754759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1297/2601] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:27.122982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.124789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.139249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539e3a-63c6-44de-ad86-569712aac103 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.153922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.155489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.155775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.156160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] PATH_INFO: `/v3/projects/b35f158acc604ad2a799512336ab8331` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.157733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35f158acc604ad2a799512336ab8331)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.160030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.242098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35f158acc604ad2a799512336ab8331', 'request_id': 'req-f3c916b1-1601-4e13-bde2-abbd26dce595'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.254069 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35f158acc604ad2a799512336ab8331', 'request_id': 'req-f3c916b1-1601-4e13-bde2-abbd26dce595'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.266018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35f158acc604ad2a799512336ab8331', 'request_id': 'req-f3c916b1-1601-4e13-bde2-abbd26dce595'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.281198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] The token cache is being invalidate because project b35f158acc604ad2a799512336ab8331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:27.281697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.282417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.286000 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1305/2602] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:27 2022] DELETE /identity/v3/projects/b35f158acc604ad2a799512336ab8331 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:27.298168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.309814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c0fe2-10d4-4166-afef-00f7c0836c92 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.376458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.377090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.378475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.378759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] PATH_INFO: `/v3/users/f86ad4ca4add432e8e06aeefab21ab9b` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.379998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86ad4ca4add432e8e06aeefab21ab9b)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.381991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.409045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:27.446636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86ad4ca4add432e8e06aeefab21ab9b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.488432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86ad4ca4add432e8e06aeefab21ab9b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.488432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86ad4ca4add432e8e06aeefab21ab9b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.489283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86ad4ca4add432e8e06aeefab21ab9b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.493208 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86ad4ca4add432e8e06aeefab21ab9b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.508169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1298/2603] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:27 2022] DELETE /identity/v3/users/f86ad4ca4add432e8e06aeefab21ab9b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:27.829021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:27.830633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:27.846321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c916b1-1601-4e13-bde2-abbd26dce595 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:27.920755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:27.922062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:27.922979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:27.923832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] PATH_INFO: `/v3/projects/c8c3501d40c246df8b53d6ef338cda7a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:27.925598 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c3501d40c246df8b53d6ef338cda7a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:27.927794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:27.942146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:27.984914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c3501d40c246df8b53d6ef338cda7a', 'request_id': 'req-97d9815a-33ef-4ea0-a963-65052a1c54ce'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:27.991940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c3501d40c246df8b53d6ef338cda7a', 'request_id': 'req-97d9815a-33ef-4ea0-a963-65052a1c54ce'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.000827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c3501d40c246df8b53d6ef338cda7a', 'request_id': 'req-97d9815a-33ef-4ea0-a963-65052a1c54ce'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.012962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] The token cache is being invalidate because project c8c3501d40c246df8b53d6ef338cda7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:28.013255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.013947 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.015919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1306/2604] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:27 2022] DELETE /identity/v3/projects/c8c3501d40c246df8b53d6ef338cda7a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:28.019927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.021373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.034577 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fad285-252e-4e74-9f1d-ec83f8d77bfd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.105966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.108818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.109948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.110275 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] PATH_INFO: `/v3/users/2681c3b6a7154b2cb20bab06e34331fd` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.114457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2681c3b6a7154b2cb20bab06e34331fd)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.116482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.169065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2681c3b6a7154b2cb20bab06e34331fd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.184169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2681c3b6a7154b2cb20bab06e34331fd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.185034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2681c3b6a7154b2cb20bab06e34331fd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.192999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2681c3b6a7154b2cb20bab06e34331fd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.193708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-24ba8701-8b18-4181-a6e3-e03a1d56d10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2681c3b6a7154b2cb20bab06e34331fd'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.211385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1299/2605] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:28 2022] DELETE /identity/v3/users/2681c3b6a7154b2cb20bab06e34331fd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:28.504735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.505841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.527561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9815a-33ef-4ea0-a963-65052a1c54ce admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.601429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.602081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.602360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.602631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] PATH_INFO: `/v3/projects/dacf606c53a541efadd950db0d82879b` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.603911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacf606c53a541efadd950db0d82879b)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.611969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.666312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacf606c53a541efadd950db0d82879b', 'request_id': 'req-418635e0-e5d7-40e8-9cfe-506a31810e37'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.677731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacf606c53a541efadd950db0d82879b', 'request_id': 'req-418635e0-e5d7-40e8-9cfe-506a31810e37'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.687792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacf606c53a541efadd950db0d82879b', 'request_id': 'req-418635e0-e5d7-40e8-9cfe-506a31810e37'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.700263 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] The token cache is being invalidate because project dacf606c53a541efadd950db0d82879b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:28.700603 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.701252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-418635e0-e5d7-40e8-9cfe-506a31810e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:28.702771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1307/2606] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:28 2022] DELETE /identity/v3/projects/dacf606c53a541efadd950db0d82879b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:28.709798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.710294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.710377 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.730889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:28.732118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.745256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:28.804354 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1300/2607] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:28.814955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.815600 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.816352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.840857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:28.842077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:28.850725 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1308/2608] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:28.855175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.865851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad275b-6409-46e9-9b24-4fbd632fe238 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.871031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.871653 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.871932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.872202 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.872903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:28.873205 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.874949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.887673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1301/2609] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:32:28.893005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.907622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513cc6-8393-445f-af83-c66be75775c2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:28.913076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:28.913680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:28.913955 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:28.914247 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:28.914876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:28.916899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:28.948806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1309/2610] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:28.953937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:28.964344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070a41-d5e9-44da-9374-c39fb26c7407 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.024971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.025616 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.025924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.026222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.026896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.028959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.054266 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1302/2611] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:28 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:29.058645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.064379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:29.071597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258f6a1-0672-4cc4-9048-640a3cedb594 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.077958 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.079181 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.079455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.079754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.080421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.084055 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.104854 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1310/2612] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:29.109406 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.120572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd8041-05c7-4b61-9a19-da57d346f292 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.126708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.127344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.127622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.127924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.128607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.130237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12b2a2-58b5-4146-82d2-c08799c3b03a admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.143244 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1303/2613] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:29.147931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.158828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6a158-7181-4a19-b234-7f9a662e3d31 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.164112 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.164961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.165277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.165547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] PATH_INFO: `/v3/projects/2e480d761b694d08a6373171e5449865/users/dde6f572ba7940cb91bf5ed3d38076e4/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.183044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e480d761b694d08a6373171e5449865, user_id=dde6f572ba7940cb91bf5ed3d38076e4, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.185755 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.209763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1311/2614] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:29 2022] PUT /identity/v3/projects/2e480d761b694d08a6373171e5449865/users/dde6f572ba7940cb91bf5ed3d38076e4/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:29.224887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5927-72c0-4bd7-ae20-7516f9e9722a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.225324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5927-72c0-4bd7-ae20-7516f9e9722a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.225637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5927-72c0-4bd7-ae20-7516f9e9722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.261283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c31a5927-72c0-4bd7-ae20-7516f9e9722a None None] MFA Rules not processed for user `dde6f572ba7940cb91bf5ed3d38076e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:29.262742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c31a5927-72c0-4bd7-ae20-7516f9e9722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:29.342214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1304/2615] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:29.354110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:29.355848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:29.420510 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383e955-a142-41a2-b863-fa06b14b3c3b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:29.424852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:29.425464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:29.425738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:29.426006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:29.434871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:29.436370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bbdf3-cc40-426b-a98a-4b87c35a3861 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:29.446714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1312/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:34.148835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.149442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.149442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.150741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1305/2617] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:32:34.157765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723893-6f58-4de4-b899-1ae715075592 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.158318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723893-6f58-4de4-b899-1ae715075592 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.158318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4723893-6f58-4de4-b899-1ae715075592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.206375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c4723893-6f58-4de4-b899-1ae715075592 None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.207918 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c4723893-6f58-4de4-b899-1ae715075592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.296976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1313/2618] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:34.308273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.310060 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.325568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:34.374955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd60f6-560d-44ff-a3be-e4c05a7a3aa3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.378805 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.379407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.379677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.379944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.393357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.395665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9006-b1da-4e7f-8298-0d78ffc5440a service glance] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.411054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1306/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:34.485822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.486107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.486382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] PATH_INFO: `/` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.487776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1314/2620] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:32:34.493348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6883-eafc-4307-bbc8-bf39c88b2116 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.493632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6883-eafc-4307-bbc8-bf39c88b2116 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.496035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd6883-eafc-4307-bbc8-bf39c88b2116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.516591 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5cfd6883-eafc-4307-bbc8-bf39c88b2116 None None] MFA Rules not processed for user `6c3846eb00ef4876952addbc1b1d1902`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.517801 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5cfd6883-eafc-4307-bbc8-bf39c88b2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.579350 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1307/2621] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:34.594557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.597144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.614862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3de3f-8686-4552-a14a-b7e097b9553c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.618839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.619443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.619717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.619982 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.628846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.630290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aead9-e341-49ef-9a7e-a63342f17c05 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.638573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1315/2622] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:34.740206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b510d2-e69f-4dd4-ba94-9d8580efd750 None None] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.740541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b510d2-e69f-4dd4-ba94-9d8580efd750 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.740881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b510d2-e69f-4dd4-ba94-9d8580efd750 None None] PATH_INFO: `/` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.742973 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1308/2623] 10.222.0.20 () {54 vars in 921 bytes} [Mon Aug 29 20:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:32:34.748300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.748623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.748896 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.771638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] MFA Rules not processed for user `2512318b0a854bd2934befc3de218102`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:34.772899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:34.784028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1316/2624] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Aug 29 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:34.794719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b510d2-e69f-4dd4-ba94-9d8580efd750 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.807121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b510d2-e69f-4dd4-ba94-9d8580efd750 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:34.811318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:34.811927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:34.812190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:34.812501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:34.823287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:34.824777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394d689-d271-44fd-b66c-ce226bfc49b4 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:34.835969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1309/2625] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:34.941950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:34.975306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.012005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477e3b-7f83-49ec-8ec9-e119218c30db None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.017784 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.018431 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.018704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.018969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] PATH_INFO: `/v3/users/dde6f572ba7940cb91bf5ed3d38076e4` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.020220 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde6f572ba7940cb91bf5ed3d38076e4)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.022412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.072675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde6f572ba7940cb91bf5ed3d38076e4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.081953 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde6f572ba7940cb91bf5ed3d38076e4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.089789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde6f572ba7940cb91bf5ed3d38076e4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.090368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde6f572ba7940cb91bf5ed3d38076e4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.106152 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde6f572ba7940cb91bf5ed3d38076e4'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.116775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1317/2626] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:34 2022] DELETE /identity/v3/users/dde6f572ba7940cb91bf5ed3d38076e4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.121233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.121524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.121798 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.141903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.143135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.206099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1310/2627] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.218011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.219585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.280177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd241c-70ee-4a93-a7e8-027a22528f9a admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.284990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.286062 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.286485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.286754 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.297201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.299033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfba66-8fd1-4a11-8a6b-2c940ea913e4 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.312745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1318/2628] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:35.675418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.678085 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.692527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c830-ecaa-404d-9396-327c0d594104 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.708607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.709473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.709724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.709998 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] PATH_INFO: `/v3/projects/2e480d761b694d08a6373171e5449865` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.711437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e480d761b694d08a6373171e5449865)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.714009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.769061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.770676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e480d761b694d08a6373171e5449865', 'request_id': 'req-116e7818-74e5-408a-ac4b-02054abc6051'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.778093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e480d761b694d08a6373171e5449865', 'request_id': 'req-116e7818-74e5-408a-ac4b-02054abc6051'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.787174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e480d761b694d08a6373171e5449865', 'request_id': 'req-116e7818-74e5-408a-ac4b-02054abc6051'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.798424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] The token cache is being invalidate because project 2e480d761b694d08a6373171e5449865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:35.798811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.799476 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-116e7818-74e5-408a-ac4b-02054abc6051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:35.801194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1311/2629] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:35 2022] DELETE /identity/v3/projects/2e480d761b694d08a6373171e5449865 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:35.807571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.807921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.808319 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.829101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.830300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.876005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:35.895226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1319/2630] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.905992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.906332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.906654 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.927429 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:35.928762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:35.937447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1312/2631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:35.942341 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.952029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2995a-def5-4113-bcf2-302b6a9fc855 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.958375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.959052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.959357 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.959624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.960304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:35.960623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.962270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:35.974568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1320/2632] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:32:35.980802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:35.988994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e682-6862-4a40-9a14-1872fb779e14 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:35.993638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:35.994243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:35.994518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:35.994796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:35.995540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:35.997423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.030687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1313/2633] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:35 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:36.032027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.042552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1d40e-7292-4c6e-b5c7-31c7ea7875b3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.103156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.103775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.104046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.104339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.104978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.106925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.130685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1321/2634] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:36.135030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.146249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b230b-a5f8-42f6-acb0-a7d8c1a939d5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.151601 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.152248 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.152568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.152880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.153556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.155193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.168694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1314/2635] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:36.174214 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.184787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfae2e-12d5-495e-a90d-1240d88864f7 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.189611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.190202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.190470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.190733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.191395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.193051 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b807f4-5b63-44df-9e7a-53ea7eaf0749 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.205709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1322/2636] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:36.210411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.224004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae68892-09c1-4805-926d-ef89e46f3e2c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.233103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.234119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.234694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.235069 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] PATH_INFO: `/v3/projects/e136df985ca2446581c4267badf96c6a/users/8b72470aa22c4f2badf001c59813ca73/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.251522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e136df985ca2446581c4267badf96c6a, user_id=8b72470aa22c4f2badf001c59813ca73, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.254339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.270019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1315/2637] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:36 2022] PUT /identity/v3/projects/e136df985ca2446581c4267badf96c6a/users/8b72470aa22c4f2badf001c59813ca73/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:36.280345 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf56a-1a63-49c1-81c2-283a98bc4631 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.280889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf56a-1a63-49c1-81c2-283a98bc4631 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.281003 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf56a-1a63-49c1-81c2-283a98bc4631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.314536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c15cf56a-1a63-49c1-81c2-283a98bc4631 None None] MFA Rules not processed for user `8b72470aa22c4f2badf001c59813ca73`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:36.315822 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c15cf56a-1a63-49c1-81c2-283a98bc4631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.390306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1323/2638] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:36.405389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:36.407876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:36.469662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6fe00-cc2b-4da8-a313-f892aa2356bd admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:36.474166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:36.474868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:36.475149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:36.475412 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:36.484864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:36.486310 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:36.497185 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1316/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:37.602297 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.602811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.602917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.623880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:37.625506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.667902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:37.684318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1324/2640] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:37.696355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.697838 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.770551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07d56c-9b9b-4830-9727-cbe0b3437f62 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:37.776938 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:37.777559 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:37.777841 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:37.778117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:37.788096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:37.789954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:37.799129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1317/2641] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:32:37.820850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:37.822627 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:37.990217 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cbbc-ccfe-4ca9-b374-af0082be5552 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:38.003030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:38.003838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:38.004114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:38.004381 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:38.011967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:38.169252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:38.171071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:38.194571 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1325/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:39.448188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.454704 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:39.459807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c7ca-3c5d-4f66-91aa-7d43bbc0182d service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.464970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.465886 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.466330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.466937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.469204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:39.483856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.485477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0c5c1-49fd-466f-83d8-a8dba5423b79 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.497541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1318/2643] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:39.820967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:39.894149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1375f-db8c-4c4f-a8ab-264efdaf84e0 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:39.899246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:39.900265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:39.900575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:39.901057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] PATH_INFO: `/v3/users/8b72470aa22c4f2badf001c59813ca73` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:39.904716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b72470aa22c4f2badf001c59813ca73)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:39.907853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:39.950643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:39.965607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b72470aa22c4f2badf001c59813ca73'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.974409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b72470aa22c4f2badf001c59813ca73'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.987997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b72470aa22c4f2badf001c59813ca73'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:39.988823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b72470aa22c4f2badf001c59813ca73'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.003147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b72470aa22c4f2badf001c59813ca73'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.014295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1326/2644] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:39 2022] DELETE /identity/v3/users/8b72470aa22c4f2badf001c59813ca73 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:40.018953 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf727-5754-4368-b410-cd5233130fdd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.019474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf727-5754-4368-b410-cd5233130fdd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.019969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf727-5754-4368-b410-cd5233130fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.043895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1addf727-5754-4368-b410-cd5233130fdd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.045140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1addf727-5754-4368-b410-cd5233130fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.106919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1319/2645] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:40.116740 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.118302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.186532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9c44-fa6c-4d36-8002-3b19d0463546 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.190447 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.191066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.191343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.191611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.201971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.203805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f78c-1733-4696-9e86-206d57c32b69 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.214762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1327/2646] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:40.510512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf727-5754-4368-b410-cd5233130fdd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.512023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1addf727-5754-4368-b410-cd5233130fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.533501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf727-5754-4368-b410-cd5233130fdd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.543602 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.544274 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.544783 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.545064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] PATH_INFO: `/v3/projects/e136df985ca2446581c4267badf96c6a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.546246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e136df985ca2446581c4267badf96c6a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.549367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.611024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e136df985ca2446581c4267badf96c6a', 'request_id': 'req-bb1c3ed1-6748-414f-8666-7f11d9b3b328'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.618215 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e136df985ca2446581c4267badf96c6a', 'request_id': 'req-bb1c3ed1-6748-414f-8666-7f11d9b3b328'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.627746 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e136df985ca2446581c4267badf96c6a', 'request_id': 'req-bb1c3ed1-6748-414f-8666-7f11d9b3b328'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.641165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] The token cache is being invalidate because project e136df985ca2446581c4267badf96c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:40.641632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.642466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bb1c3ed1-6748-414f-8666-7f11d9b3b328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:40.644426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1320/2647] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:40 2022] DELETE /identity/v3/projects/e136df985ca2446581c4267badf96c6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:40.649281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.649506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.649781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.676824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.678295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.756581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1328/2648] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:40.763673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.763955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.764230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.785645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:40.786848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:40.795456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1321/2649] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:40.799633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.810751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b07b7-f5c7-404e-92b3-d165e45925b3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.823863 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.825173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.825451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.825719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.826379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:32:40.826680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.828841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.858130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1329/2650] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:32:40.863320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.873172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0612e1-2215-41d4-8378-7d0aea321d71 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.878193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:40.879585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:40.879932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:40.880210 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:40.880895 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:40.882823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:40.916480 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1322/2651] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:40.918533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:40.932132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138f85f-ae9d-48d1-9f98-7b06f4f73227 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:40.979174 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:41.000030 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.000684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.000961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.001221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.001867 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.003829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.029492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1330/2652] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:40 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:41.033487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.044657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a266-5375-43ec-ae51-c70ca6fa13cf admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.055092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.055979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.056362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.056803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.057656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.060161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.072251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1323/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.076444 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.087136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c36ab-c80f-4d8b-b63e-7ec7c9fe5c94 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.092086 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.092719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.092996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.093269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.094407 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.096091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849955f-eb30-4763-9811-2386d76fc429 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.107730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1331/2654] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.112681 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.123410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34cf6-3cd7-47ef-9302-f617052f34d6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.128262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.128958 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.129207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.129511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] PATH_INFO: `/v3/projects/54fb324d8570409ca66bf0729b52a261/users/fa20307cad8c45759e1559af615ba79c/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.146699 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fb324d8570409ca66bf0729b52a261, user_id=fa20307cad8c45759e1559af615ba79c, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.149407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.164607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1324/2655] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:41 2022] PUT /identity/v3/projects/54fb324d8570409ca66bf0729b52a261/users/fa20307cad8c45759e1559af615ba79c/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:41.241134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.241429 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.241753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.274128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] MFA Rules not processed for user `fa20307cad8c45759e1559af615ba79c`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:41.275356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:41.344651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1332/2656] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:41.349608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.363849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:41.432328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb84e0-5d0b-4399-9288-24042ff6ac2d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.437277 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.437954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.438313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.438621 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.439238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.441221 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.473505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1325/2657] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:41.474477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.485942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83d709-8c7f-4d71-a484-fdbdd1f07da5 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.552829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.553482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.553911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.554186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.554826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.556804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.582802 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1333/2658] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:32:41.587005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.598003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e75e7-5c51-4fda-9115-be3a5a8b437f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.605039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.605678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.605977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.606252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.606900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.608716 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.620875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1326/2659] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.625384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.638215 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecb0f-28ff-4bea-b10e-5c2ab469a91b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.643916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.644559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.644840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.645111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.645795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.647409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f34f42-be1e-4323-82c3-3d23903bf3d9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.660445 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1334/2660] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:41.664780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.675482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833ebff-66e5-4db6-a263-480750e8b3ad admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.680403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.681249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.681606 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.681880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] PATH_INFO: `/v3/projects/f1cf7c84d3764d37b2c3e14650627643/users/40f1c580e09f47b7a8b1a74f0ed955f4/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.698523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cf7c84d3764d37b2c3e14650627643, user_id=40f1c580e09f47b7a8b1a74f0ed955f4, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.701370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:41.716451 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1327/2661] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:41 2022] PUT /identity/v3/projects/f1cf7c84d3764d37b2c3e14650627643/users/40f1c580e09f47b7a8b1a74f0ed955f4/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:41.727811 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.728090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.728355 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.759267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] MFA Rules not processed for user `40f1c580e09f47b7a8b1a74f0ed955f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:41.760524 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:41.781025 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:41.844687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1335/2662] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:41.850984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:41.945510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1f88-b4b2-402c-83e3-dfe479584332 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:41.958073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:41.959072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:41.959544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:41.960034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:41.961174 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:41.963808 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.000259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1328/2663] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:32:41 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:42.002070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.021313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c868cd0-32cf-4798-9d10-0496fff640cd None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.125115 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.125984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.126416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.126694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.127360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.129391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.154207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1336/2664] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:32:42 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:32:42.158029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.172482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bac0c9-e4c4-4610-8ab0-48c80c7e7a66 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.177293 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.177924 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.178206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.178481 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.179145 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.180814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.192544 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1329/2665] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:32:42.197567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.210450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17491706-e0ab-4754-a489-f89a37afdb29 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.215936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.216813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.217155 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.217713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] PATH_INFO: `/v3/projects/54567d00f2294f349df8508373ab6b7e/users/346a9603c31746a0ba4789d46f04d830/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.236282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54567d00f2294f349df8508373ab6b7e, user_id=346a9603c31746a0ba4789d46f04d830, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.238990 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.256440 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1337/2666] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:42 2022] PUT /identity/v3/projects/54567d00f2294f349df8508373ab6b7e/users/346a9603c31746a0ba4789d46f04d830/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:42.258147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.269407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46630e-9aad-497c-9ed1-085b5febacae admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.303647 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:42.332026 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.332951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.333338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.333747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.336815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.336815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f34f26-935e-46e2-8682-47437642a331 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.351526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1330/2667] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:32:42.352868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.364606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8743431-4d7a-4ed1-b31b-8c012fd57411 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.369668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.370351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.370626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.370894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] PATH_INFO: `/v3/projects/54567d00f2294f349df8508373ab6b7e/users/346a9603c31746a0ba4789d46f04d830/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.372841 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54567d00f2294f349df8508373ab6b7e, user_id=346a9603c31746a0ba4789d46f04d830, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.375660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.387774 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1338/2668] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:32:42 2022] PUT /identity/v3/projects/54567d00f2294f349df8508373ab6b7e/users/346a9603c31746a0ba4789d46f04d830/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:42.398907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.399175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.399447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.434650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] MFA Rules not processed for user `346a9603c31746a0ba4789d46f04d830`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:42.441373 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:42.522534 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1331/2669] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:32:42.535052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:42.537391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:42.606969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992d3b-8a5d-4f88-b471-fabfbb15abe1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:42.611594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:42.612291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:42.612674 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:42.613012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:42.639828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:42.675807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:42.677482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:42.686712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1339/2670] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:44.257411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:44.258857 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:44.272458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f011bf-dbca-4101-893a-4b08b89b4421 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:44.275804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:44.276453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:44.276741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:44.277019 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:44.346744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:44.348258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:44.360612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1332/2671] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:45.000601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:45.009816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f62e8-a714-4f1e-b869-0a336d4069dd service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:45.014031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:45.014751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:45.015110 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:45.015562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:45.026417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:45.027866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdd305-121e-4ed3-8e68-49a7dfdf3d5e service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:45.038900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1340/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:49.055645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.124417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:49.131651 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14d74-68fe-4b51-9c22-7672bd426c45 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.136524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.137166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.137453 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.137728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] PATH_INFO: `/v3/users/fa20307cad8c45759e1559af615ba79c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.139068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa20307cad8c45759e1559af615ba79c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.141110 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.192003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa20307cad8c45759e1559af615ba79c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.208927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa20307cad8c45759e1559af615ba79c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.209831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa20307cad8c45759e1559af615ba79c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.220199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa20307cad8c45759e1559af615ba79c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.221107 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa20307cad8c45759e1559af615ba79c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.239917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1333/2673] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:49 2022] DELETE /identity/v3/users/fa20307cad8c45759e1559af615ba79c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:49.244587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.245124 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.245226 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.267016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:49.268261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:49.330607 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1341/2674] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:49.340516 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.342309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:49.401698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42136c65-e962-42a1-b7a0-7ac2b21106d6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.406898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.407548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.407828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.408099 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.418883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.420344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.430490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1334/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:49.712969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.714434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:49.729116 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc92e-d483-480e-89dd-8dc63ede874c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.735550 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.736362 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.736798 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.737076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] PATH_INFO: `/v3/projects/54fb324d8570409ca66bf0729b52a261` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.738361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fb324d8570409ca66bf0729b52a261)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.740306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.790963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fb324d8570409ca66bf0729b52a261', 'request_id': 'req-a967a5e8-0565-4ba4-a540-77923311bc72'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.797372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fb324d8570409ca66bf0729b52a261', 'request_id': 'req-a967a5e8-0565-4ba4-a540-77923311bc72'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.806125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fb324d8570409ca66bf0729b52a261', 'request_id': 'req-a967a5e8-0565-4ba4-a540-77923311bc72'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.818579 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] The token cache is being invalidate because project 54fb324d8570409ca66bf0729b52a261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:49.818866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.819583 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.821198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1342/2676] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:49 2022] DELETE /identity/v3/projects/54fb324d8570409ca66bf0729b52a261 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:49.825477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:49.835869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9d7ea-e1ec-4f00-a4fb-323b8ce07c4e service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:49.898437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:49.899111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:49.899391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:49.899689 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] PATH_INFO: `/v3/users/40f1c580e09f47b7a8b1a74f0ed955f4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:49.900888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f1c580e09f47b7a8b1a74f0ed955f4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:49.902824 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:49.924102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:49.952568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f1c580e09f47b7a8b1a74f0ed955f4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.965151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f1c580e09f47b7a8b1a74f0ed955f4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.965799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f1c580e09f47b7a8b1a74f0ed955f4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.973135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f1c580e09f47b7a8b1a74f0ed955f4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.974089 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f1c580e09f47b7a8b1a74f0ed955f4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:49.989329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1335/2677] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:49 2022] DELETE /identity/v3/users/40f1c580e09f47b7a8b1a74f0ed955f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:50.282638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:50.284344 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:50.299302 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967a5e8-0565-4ba4-a540-77923311bc72 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:50.338230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:50.367683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:50.368315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:50.368620 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:50.368890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] PATH_INFO: `/v3/projects/f1cf7c84d3764d37b2c3e14650627643` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:50.370047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cf7c84d3764d37b2c3e14650627643)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:50.372085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:50.426632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cf7c84d3764d37b2c3e14650627643', 'request_id': 'req-bf333843-955a-4e6a-80d7-8add021d7f52'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.436310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cf7c84d3764d37b2c3e14650627643', 'request_id': 'req-bf333843-955a-4e6a-80d7-8add021d7f52'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.446572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cf7c84d3764d37b2c3e14650627643', 'request_id': 'req-bf333843-955a-4e6a-80d7-8add021d7f52'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.459974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] The token cache is being invalidate because project f1cf7c84d3764d37b2c3e14650627643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:50.460296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.460980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.462538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:50 2022] DELETE /identity/v3/projects/f1cf7c84d3764d37b2c3e14650627643 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:50.466792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:50.469149 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:50.482357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3ba2-25d8-4068-a065-ba31cb968f8c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:50.545315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:50.545954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:50.546231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:50.546547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] PATH_INFO: `/v3/users/346a9603c31746a0ba4789d46f04d830` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:50.547635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346a9603c31746a0ba4789d46f04d830)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:50.549597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:50.602156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346a9603c31746a0ba4789d46f04d830'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.617939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346a9603c31746a0ba4789d46f04d830'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.619123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346a9603c31746a0ba4789d46f04d830'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.629148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346a9603c31746a0ba4789d46f04d830'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.630004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346a9603c31746a0ba4789d46f04d830'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:50.645017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1336/2679] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:32:50 2022] DELETE /identity/v3/users/346a9603c31746a0ba4789d46f04d830 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:32:50.930035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:50.931489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:50.948267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf333843-955a-4e6a-80d7-8add021d7f52 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:51.018649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:51.019199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:51.019481 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:51.019751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] PATH_INFO: `/v3/projects/54567d00f2294f349df8508373ab6b7e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:51.020945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54567d00f2294f349df8508373ab6b7e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:51.022852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:51.077241 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54567d00f2294f349df8508373ab6b7e', 'request_id': 'req-2eed815b-55a1-4b02-a03b-fa7970f7e848'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:51.083751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54567d00f2294f349df8508373ab6b7e', 'request_id': 'req-2eed815b-55a1-4b02-a03b-fa7970f7e848'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:51.093932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54567d00f2294f349df8508373ab6b7e', 'request_id': 'req-2eed815b-55a1-4b02-a03b-fa7970f7e848'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:51.096300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:51.108249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] The token cache is being invalidate because project 54567d00f2294f349df8508373ab6b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:32:51.108612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:51.110020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-2eed815b-55a1-4b02-a03b-fa7970f7e848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:32:51.111527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1344/2680] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:32:50 2022] DELETE /identity/v3/projects/54567d00f2294f349df8508373ab6b7e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:32:57.657127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:57.658921 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.681165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:32:57.724522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a378e8-390d-4bd0-abaa-0abfa8a9b5f6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:57.782291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:57.782803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:57.783084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:57.783356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:57.785391 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:57.795164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:57.796741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:57.805255 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1337/2681] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:32:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:32:59.419133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.419624 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.419721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.473361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:32:59.474562 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.560428 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1345/2682] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:32:59.572254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:32:59.574655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:32:59.692039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf566e8-ef45-41ca-ba12-313a95951f0b service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:32:59.697696 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:32:59.698315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:32:59.698596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:32:59.698870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:32:59.708555 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:32:59.710164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:32:59.719009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1338/2683] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:33:09.551838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=42 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:09.715175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=80 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:33:56.965533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:33:56.967730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:57.054021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e3144-9e49-4942-8e82-883211ab5c10 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:33:57.061206 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:33:57.062072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:33:57.062350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:33:57.062619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:33:57.064597 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:33:57.081746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:33:57.083628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:33:57.096584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1346/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:02.760878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:02.762592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:02.775540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d54be-d100-41d5-ae4b-749f27160776 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:02.779380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:02.780136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:02.780417 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:02.780718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:02.782547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:02.848178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:02.849579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:02.859759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1339/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:06.219825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:06.221874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:06.238060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346774a2-42ce-425c-b827-d4a13141e76b service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:06.243405 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:06.244060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.244360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.244661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] PATH_INFO: `/v3/users/e7cf1859de244861995386780e46f0cf` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.260963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cf1859de244861995386780e46f0cf)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:06.262961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:06.315210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cf1859de244861995386780e46f0cf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.323371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cf1859de244861995386780e46f0cf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.332122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cf1859de244861995386780e46f0cf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.332886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cf1859de244861995386780e46f0cf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.346234 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-bb28a4c4-23f2-44f1-8ef5-fcf41e4b9e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cf1859de244861995386780e46f0cf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.352730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:06 2022] DELETE /identity/v3/users/e7cf1859de244861995386780e46f0cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:06.538537 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:06.549006 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cac6-1b87-4206-bf1f-43350c207664 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:06.616123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:06.616835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.617111 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.617381 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] PATH_INFO: `/v3/projects/bef6b580b86f4e94bc2aeb8677da8781` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.629529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef6b580b86f4e94bc2aeb8677da8781)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:06.631475 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:06.684030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef6b580b86f4e94bc2aeb8677da8781', 'request_id': 'req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.694916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef6b580b86f4e94bc2aeb8677da8781', 'request_id': 'req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.707178 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef6b580b86f4e94bc2aeb8677da8781', 'request_id': 'req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.723329 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] The token cache is being invalidate because project bef6b580b86f4e94bc2aeb8677da8781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:06.723718 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.724634 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-78e6d5ca-e0a4-4f3a-8b44-dfb89da96475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:06.727579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1340/2687] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:06 2022] DELETE /identity/v3/projects/bef6b580b86f4e94bc2aeb8677da8781 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:06.735039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.735495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.735906 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.759902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:06.761313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:06.810054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:06.831397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1348/2688] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:06.839612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.839898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.840167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.862254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:06.863497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:06.873866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1341/2689] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:06.878416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:06.889114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ed6f0-8acf-4fda-b200-13bf456118e8 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:06.894836 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:06.895460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.895730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.896002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.896691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:06.897009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:06.898618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:06.912495 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1349/2690] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:06.917519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:06.928095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548926d-b148-47e0-8aed-0ada9f3786b8 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:06.933996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:06.934608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:06.934970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:06.935270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:06.935900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:06.938460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:06.944016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:06.968550 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1342/2691] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:06 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:06.972855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:06.986702 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4e11c-c055-4c0a-9a10-200752c3179f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:07.060532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5266-953e-4925-9895-99278145205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:07.061305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5266-953e-4925-9895-99278145205f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.061557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5266-953e-4925-9895-99278145205f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.061824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5266-953e-4925-9895-99278145205f admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.062477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5266-953e-4925-9895-99278145205f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:07.064386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5266-953e-4925-9895-99278145205f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:07.088856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1350/2692] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:06 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:07.093390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:07.105083 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71de5b-bd40-4256-93d4-f22dd4418fb6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:07.111433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:07.112070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.112352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.112671 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.113409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:07.115064 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:07.128759 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1343/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:07.132949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5266-953e-4925-9895-99278145205f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:07.146364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5266-953e-4925-9895-99278145205f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:07.153496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:07.153496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.153496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.153865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.154324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:07.156114 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ff68-6c34-4f47-8dae-fd90504f8a88 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:07.170824 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1351/2694] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:34:07.174578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:07.185849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375dc1-216c-4eea-bc44-80e4f5e678de admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:07.191045 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:07.191710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.191988 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.192263 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] PATH_INFO: `/v3/projects/bf3eda367eb44b0c96d7c480d7285b80/users/7f065b9b96ec4c0294541709022cdbfa/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.211545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3eda367eb44b0c96d7c480d7285b80, user_id=7f065b9b96ec4c0294541709022cdbfa, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:07.216082 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:07.232408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1344/2695] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:07 2022] PUT /identity/v3/projects/bf3eda367eb44b0c96d7c480d7285b80/users/7f065b9b96ec4c0294541709022cdbfa/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:07.244064 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.244707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.244707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.277279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] MFA Rules not processed for user `7f065b9b96ec4c0294541709022cdbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:07.278491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:07.361815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1352/2696] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:07.373870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:07.375675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:07.472443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbe938-617e-4860-935b-fdf89de3f278 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:07.478545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:07.479166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:07.479471 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:07.479747 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:07.490042 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:07.491847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7360d-a0d8-44e1-a802-770581fd7b2d service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:07.502460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1345/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:12.810107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:12.869631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:12.890432 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de451-8719-476c-bf73-9c2096454c43 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:12.895063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:12.895701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:12.895973 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:12.896235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] PATH_INFO: `/v3/users/7f065b9b96ec4c0294541709022cdbfa` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:12.897380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f065b9b96ec4c0294541709022cdbfa)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:12.899301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:12.961699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f065b9b96ec4c0294541709022cdbfa'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:12.970857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f065b9b96ec4c0294541709022cdbfa'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:12.986584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f065b9b96ec4c0294541709022cdbfa'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:12.987552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f065b9b96ec4c0294541709022cdbfa'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.000492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f065b9b96ec4c0294541709022cdbfa'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.006649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1353/2698] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:12 2022] DELETE /identity/v3/users/7f065b9b96ec4c0294541709022cdbfa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:13.011359 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.011848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.012029 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.031442 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:13.032806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.111668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1346/2699] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:13.120963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:13.123072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.236996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec60e-df34-4a35-9a6f-3951973cdc4e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:13.242543 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:13.243288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.243661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.244023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.256611 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:13.258491 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b5b51-d4ee-4cf7-98fc-8a8bdf2a5f1e service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:13.270569 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1354/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:13.653576 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:13.655216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.668630 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d162-634b-43a3-a1b9-9bd710d92951 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:13.674462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:13.675831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.675831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.675831 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] PATH_INFO: `/v3/projects/bf3eda367eb44b0c96d7c480d7285b80` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.677227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3eda367eb44b0c96d7c480d7285b80)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:13.679183 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:13.724542 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.742505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3eda367eb44b0c96d7c480d7285b80', 'request_id': 'req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.749198 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3eda367eb44b0c96d7c480d7285b80', 'request_id': 'req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.758376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3eda367eb44b0c96d7c480d7285b80', 'request_id': 'req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.772884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] The token cache is being invalidate because project bf3eda367eb44b0c96d7c480d7285b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:13.773339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.774112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-54e3eeb1-7b1f-415f-a61c-e1c5c37b2b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:13.775835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1347/2701] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:13 2022] DELETE /identity/v3/projects/bf3eda367eb44b0c96d7c480d7285b80 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:13.782183 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.782570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.782901 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.805221 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:13.806535 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.899366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1355/2702] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:13.907649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.909142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.909459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.943897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:13.945222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:13.954919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1348/2703] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:13.959395 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:13.967041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:13.976697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb163a-f71c-4480-84f4-cba3126ce08d None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:13.986807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:13.988029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:13.988379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:13.988803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:13.989677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:13.990240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:13.992244 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.007474 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1356/2704] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:14.013166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.022353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7e727-b257-4489-9d0d-d3e2a983b907 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.027455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.028115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.028434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.028710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.029431 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.031784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.075071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1349/2705] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:14.076868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.088072 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5092ebc-6dfa-46e9-8696-6f5638af7241 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.155716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.156046 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.156253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.156517 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.157153 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.159125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.184853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1357/2706] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:14.189978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.200675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b12f50-1613-43c0-8cf6-7c22ea76ec61 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.206766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.207426 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.208004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.208004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.208666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.210389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.226802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1350/2707] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:14.228210 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.240342 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50f61-7836-46b9-9201-f43209779a84 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.245537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.246198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.246471 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.246736 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.247386 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.249705 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6406b10-bfef-4a4e-8bfe-7f00c71227e2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.263885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1358/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:14.269344 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.287319 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dfae7-6de9-4dc1-8668-c8406715c048 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.292804 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.293548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.293881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.294156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] PATH_INFO: `/v3/projects/42296fca4305426ab44d229e9517c5f0/users/393007bc89154c7493eda96ba4ad09a7/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.313608 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42296fca4305426ab44d229e9517c5f0, user_id=393007bc89154c7493eda96ba4ad09a7, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.318509 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.334283 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1351/2709] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:14 2022] PUT /identity/v3/projects/42296fca4305426ab44d229e9517c5f0/users/393007bc89154c7493eda96ba4ad09a7/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:14.346599 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.346885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.347156 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.379745 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] MFA Rules not processed for user `393007bc89154c7493eda96ba4ad09a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:14.381041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:14.460249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1359/2710] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:14.465093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.546403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91d1b-b631-43c1-8583-fa1e2955520e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.559347 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.560447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.560991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.561212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.562740 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.566177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.601969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1352/2711] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:14.606894 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.618106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef50376-48b2-468d-b611-637327fe9bf2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.684276 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.684928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.685209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.685482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.686255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.688913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.697364 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:14.716976 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1360/2712] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:14.721796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.737572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d568a6-f738-4be1-9095-6cadac4b6897 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.745080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.745727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.746102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.746323 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.746967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.749384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.760864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1353/2713] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:14.765621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.779456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412929-f771-41dc-ba43-1414ce56f24b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.785285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341664-8140-4df5-b435-48133039686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.786050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341664-8140-4df5-b435-48133039686d admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.786720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341664-8140-4df5-b435-48133039686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.786720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01341664-8140-4df5-b435-48133039686d admin admin] PATH_INFO: `/v3/projects/872f36b0be474a029f085fe42ec8de1c/users/2a203f45db4d4817aeea3e5378972327/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.803916 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341664-8140-4df5-b435-48133039686d admin admin] RBAC: Authorizing `identity:create_grant(project_id=872f36b0be474a029f085fe42ec8de1c, user_id=2a203f45db4d4817aeea3e5378972327, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.806570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01341664-8140-4df5-b435-48133039686d admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.824279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1361/2714] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:14 2022] PUT /identity/v3/projects/872f36b0be474a029f085fe42ec8de1c/users/2a203f45db4d4817aeea3e5378972327/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:14.826034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.838035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a55bd6-4b5c-4214-8a59-5aa756b557b0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.879725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:14.914545 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.915351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.915724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.916108 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.916931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.918738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f089f-bf47-4ec9-9770-5f2ed9dee38d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.929866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1354/2715] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:14.935057 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341664-8140-4df5-b435-48133039686d admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:14.947633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01341664-8140-4df5-b435-48133039686d admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:14.954891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:14.955636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.956009 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.956346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] PATH_INFO: `/v3/projects/872f36b0be474a029f085fe42ec8de1c/users/2a203f45db4d4817aeea3e5378972327/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:14.958492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] RBAC: Authorizing `identity:create_grant(project_id=872f36b0be474a029f085fe42ec8de1c, user_id=2a203f45db4d4817aeea3e5378972327, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:14.961335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:14.974337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1362/2716] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:14 2022] PUT /identity/v3/projects/872f36b0be474a029f085fe42ec8de1c/users/2a203f45db4d4817aeea3e5378972327/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:14.987251 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250345-367c-4869-ad50-0680d0d54882 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:14.987593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250345-367c-4869-ad50-0680d0d54882 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:14.987935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90250345-367c-4869-ad50-0680d0d54882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:15.018378 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-90250345-367c-4869-ad50-0680d0d54882 None None] MFA Rules not processed for user `2a203f45db4d4817aeea3e5378972327`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:15.019604 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-90250345-367c-4869-ad50-0680d0d54882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:15.102258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1355/2717] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:15.114554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:15.116374 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:15.189166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946f9d-1b4c-4693-a3ad-7053503860df admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:15.194360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:15.194987 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:15.195360 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:15.195669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:15.206782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:15.208266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190e5b5-bb0e-4c11-8946-aeef270feb4d service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:15.219382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1363/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:15.694548 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90250345-367c-4869-ad50-0680d0d54882 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:15.765241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90250345-367c-4869-ad50-0680d0d54882 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:15.769614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:15.770260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:15.770540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:15.770809 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] PATH_INFO: `/v3/users/393007bc89154c7493eda96ba4ad09a7` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:15.772040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393007bc89154c7493eda96ba4ad09a7)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:15.774007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:15.831643 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393007bc89154c7493eda96ba4ad09a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:15.837784 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:15.847081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393007bc89154c7493eda96ba4ad09a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:15.847898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393007bc89154c7493eda96ba4ad09a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:15.855272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393007bc89154c7493eda96ba4ad09a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:15.855964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393007bc89154c7493eda96ba4ad09a7'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:15.870477 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1356/2719] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:15 2022] DELETE /identity/v3/users/393007bc89154c7493eda96ba4ad09a7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:15.875734 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:15.876020 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:15.876293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:15.901248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:15.902645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:15.972004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1364/2720] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:15.982884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:15.985421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:16.054947 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a59f-fad9-4fa8-a0c0-e29f5cce07b2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:16.058903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:16.059527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:16.059807 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:16.060102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:16.070121 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:16.071568 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:16.082688 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1357/2721] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:16.379608 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:16.381421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:16.397011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcb68-ebd2-461a-b50f-3b0057261bdc None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:16.409601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:16.410269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:16.410800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:16.411080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] PATH_INFO: `/v3/projects/42296fca4305426ab44d229e9517c5f0` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:16.412269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42296fca4305426ab44d229e9517c5f0)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:16.414225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:16.466634 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42296fca4305426ab44d229e9517c5f0', 'request_id': 'req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.467928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:16.478813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42296fca4305426ab44d229e9517c5f0', 'request_id': 'req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.486989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42296fca4305426ab44d229e9517c5f0', 'request_id': 'req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.499743 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] The token cache is being invalidate because project 42296fca4305426ab44d229e9517c5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:16.500029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.500747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.502557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1365/2722] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:16 2022] DELETE /identity/v3/projects/42296fca4305426ab44d229e9517c5f0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:16.507989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:16.519402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899942a3-2f43-44af-b583-2b43877ef428 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:16.590813 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:16.591371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:16.591648 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:16.591916 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] PATH_INFO: `/v3/users/2a203f45db4d4817aeea3e5378972327` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:16.593187 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a203f45db4d4817aeea3e5378972327)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:16.595118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:16.658269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a203f45db4d4817aeea3e5378972327'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.673201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a203f45db4d4817aeea3e5378972327'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.674021 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a203f45db4d4817aeea3e5378972327'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.682725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a203f45db4d4817aeea3e5378972327'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.683666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-0646e32d-5423-47d2-ab5e-a64562efcac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a203f45db4d4817aeea3e5378972327'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:16.687250 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:16.705636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1358/2723] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:16 2022] DELETE /identity/v3/users/2a203f45db4d4817aeea3e5378972327 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:17.000549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.002060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.016581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb3de-10a9-4a85-8436-b27b4a7f16b5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.091045 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.091714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.091995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.092348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] PATH_INFO: `/v3/projects/872f36b0be474a029f085fe42ec8de1c` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.093884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=872f36b0be474a029f085fe42ec8de1c)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.095814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.148616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872f36b0be474a029f085fe42ec8de1c', 'request_id': 'req-7f217787-7f68-439b-b148-8c6cee455fff'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.155533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872f36b0be474a029f085fe42ec8de1c', 'request_id': 'req-7f217787-7f68-439b-b148-8c6cee455fff'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.164317 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872f36b0be474a029f085fe42ec8de1c', 'request_id': 'req-7f217787-7f68-439b-b148-8c6cee455fff'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.177224 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] The token cache is being invalidate because project 872f36b0be474a029f085fe42ec8de1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:17.177723 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.178409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7f217787-7f68-439b-b148-8c6cee455fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:17.179979 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1366/2724] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:16 2022] DELETE /identity/v3/projects/872f36b0be474a029f085fe42ec8de1c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:17.184843 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.185326 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.185422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.208188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:17.209527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.277276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1359/2725] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:17.285326 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.285644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.285873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.306891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:17.308107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.318538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1367/2726] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:17.323114 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.335611 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8f219-eba3-4635-8a6f-ddda4821f561 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.341218 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.342212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.342662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.343574 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.344240 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:17.344575 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.346216 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.361869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1360/2727] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:17.366409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.376886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ba982-e469-42ec-96f5-b180bf6dfc5c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.382387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.383027 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.383310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.383576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.384227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.386173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.417685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1368/2728] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:17.422146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.433296 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c35eb-8158-4b3a-87fe-753a8ca37548 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.503674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.504478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.504762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.505034 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.505687 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.507656 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.535317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1361/2729] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:17.536711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.548983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbf37-22dc-4b9f-8416-2511feea0500 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.553667 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.554283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.554558 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.554833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.555470 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.557125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.568275 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1369/2730] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:17.572499 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.585424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c3c98-fd15-4532-915d-d975e9f1fcfb admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.590899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.591570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.591850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.592123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.593115 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.594981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6415626-cf88-453e-94f9-16c6bbba9328 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.607061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1362/2731] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:17.611655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.623300 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2df6-588f-458d-9c1f-b53e56f2ac58 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.629683 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.630449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.630817 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.631059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] PATH_INFO: `/v3/projects/4529510f993f4d2181854b908a99393a/users/7228d50ff48c43dd8aad0486cb1f4cb9/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.651823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4529510f993f4d2181854b908a99393a, user_id=7228d50ff48c43dd8aad0486cb1f4cb9, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.654903 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75b1d6-42da-4de8-a708-763917e6c850 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.660147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.660493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.660823 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.671190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1370/2732] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:17 2022] PUT /identity/v3/projects/4529510f993f4d2181854b908a99393a/users/7228d50ff48c43dd8aad0486cb1f4cb9/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:17.682259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.682534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.682804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.683004 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] MFA Rules not processed for user `72e3a754496f407c9f4a063764369a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:17.684231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.692868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:17.721712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] MFA Rules not processed for user `7228d50ff48c43dd8aad0486cb1f4cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:17.723076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:17.770579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1363/2733] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:17.794006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1371/2734] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:17.798892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.805231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:17.871706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4613b2-8ffd-49ef-8dc9-c6c9ba86fb96 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.876986 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.877693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.878011 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.878249 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.878981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:17.880954 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:17.915500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1364/2735] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:17.919961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:17.932073 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfba0-6158-4894-80ba-3da01343d25a None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:17.997747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:17.998523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:17.998834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:17.999101 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:17.999718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.001826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.028442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1372/2736] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:17 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:18.033695 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.049662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7202d-4780-4505-a845-b8cb74bdbcee admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.063454 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.064093 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.064374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.064677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.065368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.067097 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.079404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1365/2737] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:18.083875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.094461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87ba9f-1dee-4d45-aff4-64a184d095c6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.099996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.100717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.100986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.101365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] PATH_INFO: `/v3/projects/83a22bc0c8a247d3988b29ba109850fe/users/b41a98757c774218aa99f53e4f1f71ee/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.120250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a22bc0c8a247d3988b29ba109850fe, user_id=b41a98757c774218aa99f53e4f1f71ee, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.125790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.146146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1373/2738] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:18 2022] PUT /identity/v3/projects/83a22bc0c8a247d3988b29ba109850fe/users/b41a98757c774218aa99f53e4f1f71ee/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:18.151074 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.162348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11c177-4f46-4ccf-9f1b-7be277d35a3c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.227411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.228848 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.229588 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.230455 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.230888 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.233061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df66794-dbd0-4432-b49e-06c06c773b31 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.251978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1366/2739] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:18.253636 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.266292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1d89-9a2a-4b5a-a529-c980884d165f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.271401 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.272142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.272437 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.272730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] PATH_INFO: `/v3/projects/83a22bc0c8a247d3988b29ba109850fe/users/b41a98757c774218aa99f53e4f1f71ee/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.274925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a22bc0c8a247d3988b29ba109850fe, user_id=b41a98757c774218aa99f53e4f1f71ee, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.278625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.296623 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1374/2740] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:18 2022] PUT /identity/v3/projects/83a22bc0c8a247d3988b29ba109850fe/users/b41a98757c774218aa99f53e4f1f71ee/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:18.308876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.309164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.309483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.339531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] MFA Rules not processed for user `b41a98757c774218aa99f53e4f1f71ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:18.340796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.409710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:18.414546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1367/2741] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:18.426409 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.428366 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.493952 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:18.500750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51425c0-c23a-40b4-aa24-ec53ff40ee91 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.506930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.507701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.508190 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.508443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.514968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.516501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.521043 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.522503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.536528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1375/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:18.609248 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.611466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234f10-8877-40b3-abcb-06c259d1eb45 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.616554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.617176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.617460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.617731 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.619484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.631908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.633560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abde8db-f642-4d75-ab7b-e8c1284844ae service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.644557 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1368/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:34:18.676968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ce2f-c55f-455c-94d6-2c3b1d669c5d service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.682577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.683368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.683761 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.684087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] PATH_INFO: `/v3/users/7228d50ff48c43dd8aad0486cb1f4cb9` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.686066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7228d50ff48c43dd8aad0486cb1f4cb9)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:18.688766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:18.746797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7228d50ff48c43dd8aad0486cb1f4cb9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:18.756559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7228d50ff48c43dd8aad0486cb1f4cb9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:18.764643 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7228d50ff48c43dd8aad0486cb1f4cb9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:18.765396 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7228d50ff48c43dd8aad0486cb1f4cb9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:18.778794 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7228d50ff48c43dd8aad0486cb1f4cb9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:18.790985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1376/2744] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:18 2022] DELETE /identity/v3/users/7228d50ff48c43dd8aad0486cb1f4cb9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:18.797117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.797571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.797996 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:18.829898 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:18.832008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.905380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1369/2745] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:18.914980 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:18.916621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:18.994324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49075bd-cb66-4098-b3df-8e9c58c65338 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:18.997997 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:18.998808 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:18.999122 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:18.999391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.008731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:19.010212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.020876 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1377/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:19.329463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:19.331014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:19.348751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3918bb-b53d-49cf-8665-e9e0442a3f57 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:19.354781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:19.355629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.355909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.356181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] PATH_INFO: `/v3/projects/4529510f993f4d2181854b908a99393a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.358016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4529510f993f4d2181854b908a99393a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:19.361102 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.420312 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4529510f993f4d2181854b908a99393a', 'request_id': 'req-66e69335-b599-4bb6-a892-e87955e0c39d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.427147 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4529510f993f4d2181854b908a99393a', 'request_id': 'req-66e69335-b599-4bb6-a892-e87955e0c39d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.436427 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4529510f993f4d2181854b908a99393a', 'request_id': 'req-66e69335-b599-4bb6-a892-e87955e0c39d'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.461088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] The token cache is being invalidate because project 4529510f993f4d2181854b908a99393a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:19.461380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.462035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.463538 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1370/2747] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:19 2022] DELETE /identity/v3/projects/4529510f993f4d2181854b908a99393a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:19.467813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:19.478066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc3edb-6a37-4f5f-9e38-980af8a0c47e service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:19.487397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:19.669332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:19.669332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:19.670060 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:19.670253 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] PATH_INFO: `/v3/users/b41a98757c774218aa99f53e4f1f71ee` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:19.672560 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41a98757c774218aa99f53e4f1f71ee)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:19.675157 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:19.748549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41a98757c774218aa99f53e4f1f71ee'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.757950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41a98757c774218aa99f53e4f1f71ee'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.766026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41a98757c774218aa99f53e4f1f71ee'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.766712 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41a98757c774218aa99f53e4f1f71ee'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.780616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b0115884-3cc0-4b9b-b362-1dcf541ebc1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41a98757c774218aa99f53e4f1f71ee'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:19.786945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1378/2748] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:19 2022] DELETE /identity/v3/users/b41a98757c774218aa99f53e4f1f71ee => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:20.113941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.115655 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:20.136328 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69335-b599-4bb6-a892-e87955e0c39d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.149338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:20.203712 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.204270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.204585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.204852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] PATH_INFO: `/v3/projects/83a22bc0c8a247d3988b29ba109850fe` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.206032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a22bc0c8a247d3988b29ba109850fe)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.207983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.260560 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a22bc0c8a247d3988b29ba109850fe', 'request_id': 'req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:20.269088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a22bc0c8a247d3988b29ba109850fe', 'request_id': 'req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:20.277991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a22bc0c8a247d3988b29ba109850fe', 'request_id': 'req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:20.290126 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] The token cache is being invalidate because project 83a22bc0c8a247d3988b29ba109850fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:20.290395 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:20.291063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-9d98fe65-ab29-4d35-a367-07b7fdeaa3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:20.292984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1371/2749] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:20 2022] DELETE /identity/v3/projects/83a22bc0c8a247d3988b29ba109850fe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:20.297891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.298417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.298417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.317917 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:20.319108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:20.382618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1379/2750] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:20.390994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.391563 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.391675 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.413222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:20.414632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:20.424123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1372/2751] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:20.428521 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.438707 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd084f7-127c-410a-91ee-dd8f281480f3 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.443632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.444087 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.444443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.444785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.445513 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:20.445971 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.447730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.461792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1380/2752] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:34:20.466098 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.476150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7dd83-dd8d-4e62-b719-39947c177f3a None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.480971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.481584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.481863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.482190 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.482908 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.485040 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.518176 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1373/2753] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:20.522503 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.537335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671285-ad3d-4408-9618-ca327548cc9e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.554769 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:20.611880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.612527 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.612816 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.613071 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.613713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.615678 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.643398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1381/2754] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:20.647486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.659777 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f80c4-4a35-4e40-95f3-5dbe757ccb48 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.666009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.666766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.667158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.667627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.668464 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.670260 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.682234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1374/2755] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:20.686865 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.709324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba177f8-d4a0-4ce6-90b6-26eefb0ac467 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.716343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.717288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.718506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.718506 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.719207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.724661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4e796-f5d4-4a81-a36c-f461b2557be5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.753966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:20.756486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1382/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:20.776482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6f2d-a0d2-47aa-8625-1867d318a848 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:20.795566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:20.796725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.798861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.798861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] PATH_INFO: `/v3/projects/58f47a45ef4140c59e766a246d2e2e30/users/f981c28e924046efab4ba077b3698f4b/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.826595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f47a45ef4140c59e766a246d2e2e30, user_id=f981c28e924046efab4ba077b3698f4b, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:20.830479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:20.852207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1375/2757] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:20 2022] PUT /identity/v3/projects/58f47a45ef4140c59e766a246d2e2e30/users/f981c28e924046efab4ba077b3698f4b/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:20.869940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:20.870270 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:20.872504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:20.919291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] MFA Rules not processed for user `f981c28e924046efab4ba077b3698f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:20.920868 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:21.002528 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1383/2758] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:21.008642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.067674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:21.097667 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0fd55-da61-4910-abca-c5b574c1b4b3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.103222 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.103853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.104148 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.104539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.105081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.107122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.142694 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1376/2759] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:21.147565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.159826 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdeccf-812f-4ddb-abed-7baf7d562184 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.246629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.247456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.247738 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.248007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.249457 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.251435 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.279529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1384/2760] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:21 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:21.281541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.292335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d399ce0-7113-4c48-8143-8ea5bc12c682 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.298665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.299236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.299519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.299795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.300474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.302106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.317313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1377/2761] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:21.318724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.330650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5762ee-4310-43bb-a0f2-d5a0f6c604c3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.336058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.336850 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.337146 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.337356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.338013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.339612 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d8a99-333b-4ac3-848e-56bbf6d511c3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.351201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1385/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:21.355803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.366854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01c5e-defb-4c28-8bd5-385e10a2e7a6 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.371693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.372472 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.372821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.373185 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] PATH_INFO: `/v3/projects/8ae03579a450473dbddb19d7a5be8169/users/a1b36f2dd1c34809b0f8a26bbbbc3182/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.390279 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae03579a450473dbddb19d7a5be8169, user_id=a1b36f2dd1c34809b0f8a26bbbbc3182, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.393123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.407664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1378/2763] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:21 2022] PUT /identity/v3/projects/8ae03579a450473dbddb19d7a5be8169/users/a1b36f2dd1c34809b0f8a26bbbbc3182/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:21.418929 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.419213 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.419482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.428430 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:21.455295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] MFA Rules not processed for user `a1b36f2dd1c34809b0f8a26bbbbc3182`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:21.457689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:21.541692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1386/2764] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:21.547335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.624518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233af2-5848-489e-b87f-7c877dbac31e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.629657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.630273 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.630543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.630825 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.631479 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.633511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.666466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1379/2765] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:21.671164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.682387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd18a2-4b8d-467b-99d7-e20327379a3f None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.747750 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.748439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.748839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.749111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.749855 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.751777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.777164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1387/2766] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:21 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:21.782403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.793785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb446-00e8-4917-9bd9-7888766cac0b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.799523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.800143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.800449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.800721 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.801370 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.802993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:21.942067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1380/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:21.946463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:21.958839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdab96-5a4b-4f9b-86ee-01ea71abc6e8 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:21.964621 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:21.965292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:21.965566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:21.965834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] PATH_INFO: `/v3/projects/2974dde0304f437a929ab4406ef26d3c/users/cfa2d14a4f4e43dfb89815197bd2f1a9/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:21.983984 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2974dde0304f437a929ab4406ef26d3c, user_id=cfa2d14a4f4e43dfb89815197bd2f1a9, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:21.986857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:22.002251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1388/2768] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:21 2022] PUT /identity/v3/projects/2974dde0304f437a929ab4406ef26d3c/users/cfa2d14a4f4e43dfb89815197bd2f1a9/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:22.006535 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:22.018421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fbaf-a776-4593-a54f-f3887734d797 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:22.093931 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:22.094433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.095182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.095182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:22.095599 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:22.097392 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9f324-0706-4f8b-a1f3-af4c107f7f2d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:22.103175 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:22.108744 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1381/2769] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:22.113370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:22.124002 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053f218-8e70-4739-9e69-6c70a993e139 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:22.128777 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:22.129425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.129687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.129951 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] PATH_INFO: `/v3/projects/2974dde0304f437a929ab4406ef26d3c/users/cfa2d14a4f4e43dfb89815197bd2f1a9/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:22.131833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2974dde0304f437a929ab4406ef26d3c, user_id=cfa2d14a4f4e43dfb89815197bd2f1a9, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:22.134489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:22.146032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1389/2770] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:22 2022] PUT /identity/v3/projects/2974dde0304f437a929ab4406ef26d3c/users/cfa2d14a4f4e43dfb89815197bd2f1a9/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:22.157404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.157404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.157404 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:22.187410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] MFA Rules not processed for user `cfa2d14a4f4e43dfb89815197bd2f1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:22.188692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:22.258737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1382/2771] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:22.270029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:22.272159 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:22.333848 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:22.340790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7c0ee-b327-4ea6-ba98-3305d936ca8c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:22.345733 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:22.346280 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.346552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.346820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:22.358310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:22.359813 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:22.370441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1390/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:22.920539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:22.922338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:22.937361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6cfe-88f5-492e-a245-7658472e777d None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:22.941726 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:22.942371 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:22.942649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:22.942920 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:23.004679 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:23.006160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:23.015943 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1383/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:27.207066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:27.216324 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283612a8-7260-4667-b41a-9c172004b949 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:27.221820 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:27.222786 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:27.223090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:27.223451 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:27.282938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:27.284570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:27.294273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1391/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:27.508146 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:27.510048 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:27.596732 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152978be-646b-4498-96f3-bf019a6e75ba service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:27.603096 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:27.603778 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:27.604051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:27.604349 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:27.606103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:27.620188 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:27.621887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc4fa-95a5-4179-a0e6-b0b4cc33947b service nova] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:27.633165 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1384/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:29.477747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:29.551752 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec23b57-5e11-4d60-8baa-b951cc5883f7 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:29.556902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:29.557530 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:29.557801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:29.558063 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] PATH_INFO: `/v3/users/f981c28e924046efab4ba077b3698f4b` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:29.559283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f981c28e924046efab4ba077b3698f4b)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:29.561265 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:29.609996 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f981c28e924046efab4ba077b3698f4b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.618665 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f981c28e924046efab4ba077b3698f4b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.631609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f981c28e924046efab4ba077b3698f4b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.632685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f981c28e924046efab4ba077b3698f4b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.647974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f981c28e924046efab4ba077b3698f4b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:29.654654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1392/2776] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:29 2022] DELETE /identity/v3/users/f981c28e924046efab4ba077b3698f4b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:29.664106 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:29.664711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:29.664711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:29.683579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:29.684812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:29.689405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=100 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:29.745945 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1385/2777] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:34:29.756261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:29.757928 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:29.768829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:29.822049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548defc-6184-4211-8c7c-f96741b535e4 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:29.826058 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:29.826711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:29.827356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:29.827692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:29.837196 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:29.838625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:29.848216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1393/2778] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:30.136423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.137889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.152324 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089b606-b58e-4275-b77a-dd81ace362e3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.158766 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.159584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.160079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.160503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] PATH_INFO: `/v3/projects/58f47a45ef4140c59e766a246d2e2e30` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.162276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f47a45ef4140c59e766a246d2e2e30)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.164673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.216522 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f47a45ef4140c59e766a246d2e2e30', 'request_id': 'req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.224207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f47a45ef4140c59e766a246d2e2e30', 'request_id': 'req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.234018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f47a45ef4140c59e766a246d2e2e30', 'request_id': 'req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.244750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] The token cache is being invalidate because project 58f47a45ef4140c59e766a246d2e2e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:30.245039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.245706 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.247223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1386/2779] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:30 2022] DELETE /identity/v3/projects/58f47a45ef4140c59e766a246d2e2e30 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:30.251537 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.261387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6062af-e1ff-4ddc-b110-fb5dc8470181 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.321746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.322348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.322631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.322886 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] PATH_INFO: `/v3/users/a1b36f2dd1c34809b0f8a26bbbbc3182` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.324036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b36f2dd1c34809b0f8a26bbbbc3182)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.326041 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.377325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b36f2dd1c34809b0f8a26bbbbc3182'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.385860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b36f2dd1c34809b0f8a26bbbbc3182'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.396050 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b36f2dd1c34809b0f8a26bbbbc3182'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.396675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b36f2dd1c34809b0f8a26bbbbc3182'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.409827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b36f2dd1c34809b0f8a26bbbbc3182'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.416250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1394/2780] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:30 2022] DELETE /identity/v3/users/a1b36f2dd1c34809b0f8a26bbbbc3182 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:30.752447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.754076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.784497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2e7-5a2d-43a7-b7d7-eb195739f5f2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.843569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:30.844135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:30.844444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:30.845092 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] PATH_INFO: `/v3/projects/8ae03579a450473dbddb19d7a5be8169` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:30.845968 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae03579a450473dbddb19d7a5be8169)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:30.847934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:30.888594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:30.902258 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae03579a450473dbddb19d7a5be8169', 'request_id': 'req-25878d72-eb3f-435c-8c69-64208161f18f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.913318 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae03579a450473dbddb19d7a5be8169', 'request_id': 'req-25878d72-eb3f-435c-8c69-64208161f18f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.922849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae03579a450473dbddb19d7a5be8169', 'request_id': 'req-25878d72-eb3f-435c-8c69-64208161f18f'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.934531 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] The token cache is being invalidate because project 8ae03579a450473dbddb19d7a5be8169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:30.934815 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.935433 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:30.937015 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1387/2781] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:30 2022] DELETE /identity/v3/projects/8ae03579a450473dbddb19d7a5be8169 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:30.941149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:30.942582 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:30.955870 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0eb6-9c16-4086-a6b1-b38f5cbd955f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:30.985573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:31.019938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.020618 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.021021 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.021292 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] PATH_INFO: `/v3/users/cfa2d14a4f4e43dfb89815197bd2f1a9` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.022419 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa2d14a4f4e43dfb89815197bd2f1a9)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.024315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.086105 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa2d14a4f4e43dfb89815197bd2f1a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.097104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa2d14a4f4e43dfb89815197bd2f1a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.104720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa2d14a4f4e43dfb89815197bd2f1a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.105790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa2d14a4f4e43dfb89815197bd2f1a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.124011 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6ae13102-38a5-49cf-8252-6e01c7b594ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa2d14a4f4e43dfb89815197bd2f1a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.131129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1395/2782] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:30 2022] DELETE /identity/v3/users/cfa2d14a4f4e43dfb89815197bd2f1a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:31.546589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.548196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:31.561017 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878d72-eb3f-435c-8c69-64208161f18f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.625486 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.626132 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.626411 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.626678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] PATH_INFO: `/v3/projects/2974dde0304f437a929ab4406ef26d3c` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.627910 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2974dde0304f437a929ab4406ef26d3c)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.629853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.686664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2974dde0304f437a929ab4406ef26d3c', 'request_id': 'req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.693118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2974dde0304f437a929ab4406ef26d3c', 'request_id': 'req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.703289 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2974dde0304f437a929ab4406ef26d3c', 'request_id': 'req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.715707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] The token cache is being invalidate because project 2974dde0304f437a929ab4406ef26d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:31.716014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.716683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7ec8a3a7-db72-4ba9-9993-ffd57fbec4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:31.718262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1388/2783] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:31 2022] DELETE /identity/v3/projects/2974dde0304f437a929ab4406ef26d3c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:31.724547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.724897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.725633 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.749873 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:31.751090 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:31.818166 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1396/2784] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:31.887627 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.888243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.888243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.912080 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:31.913425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:31.922511 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1389/2785] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:31.926552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.936962 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26743c3-41b8-476f-8587-c607c0e9e27e None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.942246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.942889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.943119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.943384 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.944036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:31.944332 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.945964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:31.959260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1397/2786] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:31.963999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:31.974751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190a3f-3b5e-46cd-b2b1-311bcc4b7c0c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:31.980867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:31.981503 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:31.981782 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:31.982090 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:31.983855 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:31.985194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.016073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1390/2787] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:31 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:34:32.020252 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.031126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db397d8-2f8d-4aa8-a916-837271f278fd admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.075556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.106526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.107227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.107576 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.108026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.108840 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.110818 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.135525 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1398/2788] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:32.139660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.152116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d5d23-7988-4286-90b2-e514dc39aa6e admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.157878 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.158594 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.158941 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.159419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.160142 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.161874 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.179543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1391/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:32.180719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.193095 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eeae12-77da-4518-a579-6f52eaf4d4ea admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.200202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.200986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.201441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.202111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.202861 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.204606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc83f9d-0216-43ba-9ee9-035a2013dff7 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.223625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1399/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:32.227035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.245799 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77045e8-452c-418d-b3bb-40df15cfaba1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.254384 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.255385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.255889 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.256409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] PATH_INFO: `/v3/projects/14579e905c014b9da2582244e5d77d53/users/0d848e17edfc4b698312ea3befb4f566/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.278592 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.287536 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14579e905c014b9da2582244e5d77d53, user_id=0d848e17edfc4b698312ea3befb4f566, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.293287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.316459 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1392/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:32 2022] PUT /identity/v3/projects/14579e905c014b9da2582244e5d77d53/users/0d848e17edfc4b698312ea3befb4f566/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:32.328520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.328806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.329076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.358832 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] MFA Rules not processed for user `0d848e17edfc4b698312ea3befb4f566`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:32.360061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:32.432585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1400/2792] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:32.437901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.515816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbebe4-3625-452e-9f27-bd0f28bf4d28 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.520584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.521197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.521470 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.521736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.522390 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.524342 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.553767 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1393/2793] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:32.557927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.569731 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ef2ab-1e74-417f-ab11-4b0c08d0eb41 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.631963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.632613 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.632891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.633162 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.633803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.635897 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.659066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1401/2794] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:32.663163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.674684 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ca6b-755b-4f23-83a7-4d8bf7bffff3 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.680200 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.680870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.681155 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.681422 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.682072 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.683678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.699881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1394/2795] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:32.701141 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.712016 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd079f-205c-4cbb-ba26-d3827bb99fcf admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.717387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.718033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.718308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.718565 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] PATH_INFO: `/v3/projects/c393289fcce5487092f48ac3c49eb672/users/14ebc2fc272844a2824c3c348923b2b6/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.735293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c393289fcce5487092f48ac3c49eb672, user_id=14ebc2fc272844a2824c3c348923b2b6, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.738097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.758433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1402/2796] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:32 2022] PUT /identity/v3/projects/c393289fcce5487092f48ac3c49eb672/users/14ebc2fc272844a2824c3c348923b2b6/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:32.762816 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.774657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8535ce-8ed8-4b30-aa80-5fe5d36ea0b8 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.833724 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.834355 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.834636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.835081 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.835752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.837396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858afb5-c5f3-4529-828e-395d9d953f20 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.848447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1395/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:32.852902 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:32.864067 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70b01-70b7-4593-8c53-67967ef63d44 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:32.869492 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:32.870291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.870711 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.871042 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] PATH_INFO: `/v3/projects/c393289fcce5487092f48ac3c49eb672/users/14ebc2fc272844a2824c3c348923b2b6/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.873346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c393289fcce5487092f48ac3c49eb672, user_id=14ebc2fc272844a2824c3c348923b2b6, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:32.876197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:32.880147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:32.890646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1403/2798] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:32 2022] PUT /identity/v3/projects/c393289fcce5487092f48ac3c49eb672/users/14ebc2fc272844a2824c3c348923b2b6/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:32.900803 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:32.901327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:32.901489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:32.929913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] MFA Rules not processed for user `14ebc2fc272844a2824c3c348923b2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:32.931131 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:32.984500 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:33.010820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1396/2799] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:33.022546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.024423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:33.084587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a201-5e2c-4784-ba89-bcd83ded66e6 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.088268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.088907 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.089184 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.089496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.098939 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.100372 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.110365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1404/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:33.195203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:33.205811 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844eeb-a04e-40a7-8b9d-a6644ca23d49 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:33.209748 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:33.210363 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:33.210642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:33.210911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:33.284372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:33.285741 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d6ef-7a2e-4b9d-af7f-f9e7e1694374 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:33.296579 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1397/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:38.206533 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:38.277476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fb56-d119-4443-a385-c65bc2cc58e9 service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:38.283080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:38.283714 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:38.283988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:38.284256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] PATH_INFO: `/v3/users/0d848e17edfc4b698312ea3befb4f566` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:38.285488 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d848e17edfc4b698312ea3befb4f566)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:38.287450 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:38.339277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d848e17edfc4b698312ea3befb4f566'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.347688 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d848e17edfc4b698312ea3befb4f566'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.355649 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d848e17edfc4b698312ea3befb4f566'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.356290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d848e17edfc4b698312ea3befb4f566'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.369573 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d848e17edfc4b698312ea3befb4f566'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.376278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1405/2802] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:38 2022] DELETE /identity/v3/users/0d848e17edfc4b698312ea3befb4f566 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:38.380957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:38.381469 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:38.381572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:38.401443 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:38.402637 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:38.470971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1398/2803] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:38.481138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:38.483120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:38.505225 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:38.546278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3bd6-962f-49f0-805c-1007ba5a3102 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:38.550932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:38.551538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:38.551812 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:38.552080 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:38.562689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:38.564130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:38.574164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1406/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:38.866062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:38.867596 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:38.881628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01808e-ea00-4f8f-a394-50cab1ea44dd None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:38.886435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:38.887075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:38.887448 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:38.887622 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] PATH_INFO: `/v3/projects/14579e905c014b9da2582244e5d77d53` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:38.888852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14579e905c014b9da2582244e5d77d53)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:38.891528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:38.942374 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14579e905c014b9da2582244e5d77d53', 'request_id': 'req-34e5cbb5-1439-4829-9cd9-b4139fce4670'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.948899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14579e905c014b9da2582244e5d77d53', 'request_id': 'req-34e5cbb5-1439-4829-9cd9-b4139fce4670'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.958389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14579e905c014b9da2582244e5d77d53', 'request_id': 'req-34e5cbb5-1439-4829-9cd9-b4139fce4670'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.970123 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] The token cache is being invalidate because project 14579e905c014b9da2582244e5d77d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:38.970405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.971053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:38.972918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1399/2805] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:38 2022] DELETE /identity/v3/projects/14579e905c014b9da2582244e5d77d53 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:38.977034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:38.988354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36f0b-f183-4508-a9e5-32bd95827b69 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.069472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.070097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.070376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.070647 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] PATH_INFO: `/v3/users/14ebc2fc272844a2824c3c348923b2b6` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.071823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ebc2fc272844a2824c3c348923b2b6)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.073775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.126919 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ebc2fc272844a2824c3c348923b2b6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.136884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ebc2fc272844a2824c3c348923b2b6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.144532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ebc2fc272844a2824c3c348923b2b6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.145193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ebc2fc272844a2824c3c348923b2b6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.158944 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-ca82425f-6a9f-4ec8-a39f-db8c8c6a1a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ebc2fc272844a2824c3c348923b2b6'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.164880 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1407/2806] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:34:38 2022] DELETE /identity/v3/users/14ebc2fc272844a2824c3c348923b2b6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:34:39.472971 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.474444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:39.489160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5cbb5-1439-4829-9cd9-b4139fce4670 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.493444 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:39.550742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.551281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.551562 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.551833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] PATH_INFO: `/v3/projects/c393289fcce5487092f48ac3c49eb672` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.553054 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c393289fcce5487092f48ac3c49eb672)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.554960 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.603212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c393289fcce5487092f48ac3c49eb672', 'request_id': 'req-647854eb-c899-4096-bdf0-915b64c8a65e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.609357 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c393289fcce5487092f48ac3c49eb672', 'request_id': 'req-647854eb-c899-4096-bdf0-915b64c8a65e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.617603 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c393289fcce5487092f48ac3c49eb672', 'request_id': 'req-647854eb-c899-4096-bdf0-915b64c8a65e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.628713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] The token cache is being invalidate because project c393289fcce5487092f48ac3c49eb672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:34:39.628999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.629680 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-647854eb-c899-4096-bdf0-915b64c8a65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:34:39.631213 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1400/2807] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:34:39 2022] DELETE /identity/v3/projects/c393289fcce5487092f48ac3c49eb672 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:39.636126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.636638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.636772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.657456 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:39.658644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:39.694932 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:39.722290 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1408/2808] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:39.730452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.730733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.731007 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.751725 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:39.753012 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:39.762227 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1401/2809] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:39.767402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.778493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a3186-fcf4-4964-98ae-732d2c80f040 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.784801 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.785397 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.785669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.785926 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.786572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:34:39.786864 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.788482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.802672 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1409/2810] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:34:39.809752 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.823974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273ad7b-c5b1-430b-8a93-6618a459ff58 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.831118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.831720 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.831991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.832280 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.832932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.834849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.866997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1402/2811] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:34:39 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:39.871699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.883404 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bc476-bffd-4d15-944d-3f36ab1ac2c5 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:39.949078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:39.949682 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:39.949959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:39.950227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:39.950843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:39.953198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:39.976762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1410/2812] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:34:39 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:34:39.981231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:39.994896 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5df33-0cf3-4ce5-abc6-5c1e6675b0b5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:40.000413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:40.001071 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.001346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.001613 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.002256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:40.003864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:40.014636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1403/2813] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:34:40.018878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:40.029520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9719-a8bc-4d4e-b984-f2dd801b7b25 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:40.034452 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:40.035052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.035327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.035594 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.036236 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:40.037945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa287d-7d3e-49cb-acdd-eafbb036cd4b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:40.050138 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1411/2814] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:34:40.055632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:40.066396 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81112833-cd3f-4902-8564-6e9d47b417a1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:40.071911 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:40.072619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.072894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.073172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] PATH_INFO: `/v3/projects/9f6cdc06d10e4dc2a92f32c818ec9d23/users/6f1f8cb72cc54177badb791fd0b3e46e/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.089901 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6cdc06d10e4dc2a92f32c818ec9d23, user_id=6f1f8cb72cc54177badb791fd0b3e46e, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:40.092870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:40.109493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1404/2815] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:34:40 2022] PUT /identity/v3/projects/9f6cdc06d10e4dc2a92f32c818ec9d23/users/6f1f8cb72cc54177badb791fd0b3e46e/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:34:40.121018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.121311 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.121726 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.152337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] MFA Rules not processed for user `6f1f8cb72cc54177badb791fd0b3e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:34:40.153639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:40.226336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1412/2816] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:34:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:34:40.238415 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:34:40.240206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:34:40.276032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:40.301418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4cdd-b8e6-4d30-ba75-3d513455db19 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:34:40.305425 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:34:40.306084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:34:40.306246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:34:40.306551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:34:40.316036 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:34:40.317512 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf47a2d-4bde-4eb9-805d-64c975cb4574 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:34:40.327300 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1405/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:34:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:34:50.223216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:34:50.322482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=11 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:15.846805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:15.917978 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c128b3-a87e-4873-9c89-8db63b648b47 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:15.924119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:15.924804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:15.925081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:15.925338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] PATH_INFO: `/v3/users/6f1f8cb72cc54177badb791fd0b3e46e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:15.926900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1f8cb72cc54177badb791fd0b3e46e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:15.929650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:15.992921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1f8cb72cc54177badb791fd0b3e46e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.001351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1f8cb72cc54177badb791fd0b3e46e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.008659 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1f8cb72cc54177badb791fd0b3e46e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.009286 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1f8cb72cc54177badb791fd0b3e46e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.021833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1f8cb72cc54177badb791fd0b3e46e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.028049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1413/2818] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:35:15 2022] DELETE /identity/v3/users/6f1f8cb72cc54177badb791fd0b3e46e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:16.032847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:16.033338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:16.033467 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:16.053876 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:35:16.055091 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:16.127449 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1406/2819] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:35:16.137391 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:16.139038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:16.205393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac577ee-8221-4eb6-97ef-d838b7aa92db admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:16.209792 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:16.211287 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:16.211931 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:16.212655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:16.229102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:16.231031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:16.247376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1414/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:35:16.533439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:16.534976 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:16.548230 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ec9c0-bb3c-4193-84c1-3146a40e1284 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:16.554897 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:16.555457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:16.555738 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:16.555995 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] PATH_INFO: `/v3/projects/9f6cdc06d10e4dc2a92f32c818ec9d23` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:16.558502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6cdc06d10e4dc2a92f32c818ec9d23)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:16.561490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:16.614554 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6cdc06d10e4dc2a92f32c818ec9d23', 'request_id': 'req-7b67129e-8312-45d1-a10e-a52125f5b3a4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.620885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6cdc06d10e4dc2a92f32c818ec9d23', 'request_id': 'req-7b67129e-8312-45d1-a10e-a52125f5b3a4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.629587 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6cdc06d10e4dc2a92f32c818ec9d23', 'request_id': 'req-7b67129e-8312-45d1-a10e-a52125f5b3a4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.641646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] The token cache is being invalidate because project 9f6cdc06d10e4dc2a92f32c818ec9d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:35:16.641934 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.642578 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7b67129e-8312-45d1-a10e-a52125f5b3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:35:16.644166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1407/2821] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:35:16 2022] DELETE /identity/v3/projects/9f6cdc06d10e4dc2a92f32c818ec9d23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:35:26.239652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:26.638792 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:35:50.232927 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:35:50.234765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:50.325985 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf77589-f701-475e-b15a-9f826bd1c81f service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:35:50.397084 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:35:50.397689 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:35:50.397961 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:35:50.398231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:35:50.400160 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:35:50.467133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:35:50.468753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:35:50.478031 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1415/2822] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:35:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:00.473655 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=84 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:15.313125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:15.313676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:15.313676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:15.337236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:15.338700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:15.398302 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1408/2823] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:15.449658 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:15.451387 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:15.526853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f83d4-a9cb-4663-a0f6-2dd7c1888d1d service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:15.532418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:15.533035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:15.533310 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:15.533572 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:15.542766 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:15.544368 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030158cb-9739-4829-a3fa-22258778e142 service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:15.553097 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1416/2824] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:36:17.633368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:17.634786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:17.738833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a3d3-4c48-4539-8a66-4590ac645bd5 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:17.743236 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:17.744053 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:17.744439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:17.744822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:17.747179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:17.767615 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:17.769408 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:17.781358 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1409/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:36:25.549715 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=32 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:27.775785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=57 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:32.585875 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683fb2-dccb-4058-b433-b1449e03c172 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:32.586394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683fb2-dccb-4058-b433-b1449e03c172 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:32.586394 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683fb2-dccb-4058-b433-b1449e03c172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:32.614810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-4c683fb2-dccb-4058-b433-b1449e03c172 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:32.616556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-4c683fb2-dccb-4058-b433-b1449e03c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:32.630555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1417/2826] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:36:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:32.644929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:32.659692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b52af3-26f7-4a2a-b157-c77877510798 service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:32.666066 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:32.666786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:32.667769 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:32.668103 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:32.678795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:32.680466 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:32.689264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1410/2827] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:36:42.603111 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:42.685832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:36:50.110691 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:50.111186 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:50.111291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:50.133363 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:36:50.134552 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:36:50.142540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1418/2828] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:36:50.155514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:36:50.166742 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4fafa-a9a5-48c4-9517-83249fc73c18 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:36:50.173022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:36:50.173629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:36:50.173903 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:36:50.174167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:36:50.183460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:36:50.185088 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:36:50.193558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1411/2829] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:36:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:37:00.127308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:00.189994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=6 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:37:58.360994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:58.362478 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:58.426819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5cf4-4b07-4455-ad45-021bc007ebd2 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:58.431164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:58.431768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:58.432040 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:58.432303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:58.434201 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:58.448209 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:58.449660 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:58.460622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1419/2830] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:37:59.666035 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:37:59.680849 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5662f-c780-491c-bb21-0bd359323aa2 service swift] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:37:59.687317 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:37:59.688164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:37:59.688510 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:37:59.688959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:37:59.692182 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:37:59.710683 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:37:59.712137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:37:59.724868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1412/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:05.242255 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:05.252307 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f081c-c252-408f-92ed-bd12695292b4 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:05.256595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:05.257202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:05.257580 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:05.257831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:05.260068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:05.334354 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:05.336006 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:05.346499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1420/2832] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:08.594626 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:08.596027 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:08.614597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccdb27-326c-4bd6-ac6f-34a360c1c848 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:08.621506 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:08.622128 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:08.622403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:08.622847 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:08.624493 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:08.638822 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:08.640526 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:08.652118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1413/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:08.688359 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:08.689956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:08.703790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b160b43-2bff-4cf3-9e77-0900e7dbc6ec service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:08.710959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:08.712173 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:08.712480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:08.712898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] PATH_INFO: `/v3/users/72e3a754496f407c9f4a063764369a39` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:08.714038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e3a754496f407c9f4a063764369a39)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:08.716032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:08.779212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e3a754496f407c9f4a063764369a39'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:08.786764 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e3a754496f407c9f4a063764369a39'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:08.794756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e3a754496f407c9f4a063764369a39'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:08.795485 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e3a754496f407c9f4a063764369a39'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:08.809279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-8ea2c5f0-51f1-4548-a206-4ca253f0019c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e3a754496f407c9f4a063764369a39'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:08.817128 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1421/2834] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:08 2022] DELETE /identity/v3/users/72e3a754496f407c9f4a063764369a39 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:09.009372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.020309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427706-cabc-4915-a94d-6a828744640a service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.081638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.082278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.082558 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.082854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] PATH_INFO: `/v3/projects/a5c4cb6aff084ce8bc482d02e09b607e` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.084003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c4cb6aff084ce8bc482d02e09b607e)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.086194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.138405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c4cb6aff084ce8bc482d02e09b607e', 'request_id': 'req-f8536a05-90c8-415c-bf2b-8ecfdb23192c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:09.145700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c4cb6aff084ce8bc482d02e09b607e', 'request_id': 'req-f8536a05-90c8-415c-bf2b-8ecfdb23192c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:09.155168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c4cb6aff084ce8bc482d02e09b607e', 'request_id': 'req-f8536a05-90c8-415c-bf2b-8ecfdb23192c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:09.166935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] The token cache is being invalidate because project a5c4cb6aff084ce8bc482d02e09b607e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:09.167223 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:09.167883 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-f8536a05-90c8-415c-bf2b-8ecfdb23192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:09.169447 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1414/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:09 2022] DELETE /identity/v3/projects/a5c4cb6aff084ce8bc482d02e09b607e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:09.174626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.174924 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.175188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.196120 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:09.197466 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:09.202499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:09.271304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1422/2836] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:09.281340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.281796 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.282061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.311267 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:09.312418 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:09.322872 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1415/2837] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:09.327306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.339256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423991c-3052-42e9-bbdf-702c63e6c5f4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.344972 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.345577 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.345853 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.346117 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.346756 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:09.347052 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.348686 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.367899 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1423/2838] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:09.375435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.388817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd565a-5fe6-4cdf-bf0c-2ba92057c3c3 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.394859 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.395462 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.395733 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.395993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.396652 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.398700 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.430884 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1416/2839] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:09.437557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.451676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7647a-489e-4daf-8994-22d155fb41f1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.514883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.515483 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.515760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.516028 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.516728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.518651 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.549235 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1424/2840] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:09.554276 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.568907 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf87-d1f8-4e01-8500-71acd3575a8c admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.574552 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.575160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.575440 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.575713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.576352 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.578024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.588631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1417/2841] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:09.593178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.603956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbc127-4ad8-4331-bf40-9a99c15793ea admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.609323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.609914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.610193 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.610461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.611106 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.612778 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ff3c7-7aa4-4cf2-9b4f-02a29e47efee admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.625340 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1425/2842] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:09.629642 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.640361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a49d5b-15d0-485b-86b6-21209c0dfcf1 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.645636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.646287 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.646569 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.646850 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] PATH_INFO: `/v3/projects/7b4e7e1adfa44b9bafdf9623febe19db/users/5b51e2c868fd4d379f2143635d5cacf4/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.662361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4e7e1adfa44b9bafdf9623febe19db, user_id=5b51e2c868fd4d379f2143635d5cacf4, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.665714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.677059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:09.682112 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1418/2843] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:09 2022] PUT /identity/v3/projects/7b4e7e1adfa44b9bafdf9623febe19db/users/5b51e2c868fd4d379f2143635d5cacf4/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:09.696534 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.697142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.697142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.727038 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] MFA Rules not processed for user `5b51e2c868fd4d379f2143635d5cacf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:09.728240 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:09.798048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1426/2844] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:09.804969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.881450 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a630f1e-1a45-4469-85ce-f3e6f417d6a2 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:09.886832 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:09.887445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:09.887727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:09.888000 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:09.888661 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:09.890570 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:09.925979 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1419/2845] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:09.930717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:09.937632 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:09.942420 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016c920-068b-4bd3-bc9b-8d1774ea8d65 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.004104 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.004744 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.004994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.005281 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.005921 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.008375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.031941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1427/2846] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:09 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:10.036619 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.049474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9dfd-3af3-4436-aef1-5a7bb096fe99 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.056423 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.057079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.057360 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.057628 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.058290 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.059900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.071547 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1420/2847] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:10.077959 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.089074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111a225-ba9f-4972-853d-d3846876c59c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.094566 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.095212 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.095486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.095732 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] PATH_INFO: `/v3/projects/f67b2a7b18ad451584f23c942941b1ba/users/363dd166318f4d81a5db5d9eff1b3683/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.110800 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67b2a7b18ad451584f23c942941b1ba, user_id=363dd166318f4d81a5db5d9eff1b3683, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.113498 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.129089 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1428/2848] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:10 2022] PUT /identity/v3/projects/f67b2a7b18ad451584f23c942941b1ba/users/363dd166318f4d81a5db5d9eff1b3683/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:10.133670 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.143985 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792f60-fea6-459e-a2e3-da808b66475d admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.209527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.210144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.210685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.210685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.211345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.212999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c932f5-61d4-4988-8f92-b227b4cf4e56 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.223793 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1421/2849] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:10.229496 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.242490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4310-ab80-4540-989e-056eb323ac66 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.247170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.247834 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.248168 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.248423 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] PATH_INFO: `/v3/projects/f67b2a7b18ad451584f23c942941b1ba/users/363dd166318f4d81a5db5d9eff1b3683/roles/094fcef4654043758d8a01fad877074a` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.250462 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67b2a7b18ad451584f23c942941b1ba, user_id=363dd166318f4d81a5db5d9eff1b3683, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.253083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.264762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1429/2850] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:10 2022] PUT /identity/v3/projects/f67b2a7b18ad451584f23c942941b1ba/users/363dd166318f4d81a5db5d9eff1b3683/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:10.275753 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.276039 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.276308 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.308800 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] MFA Rules not processed for user `363dd166318f4d81a5db5d9eff1b3683`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:10.310025 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:10.385299 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:10.395868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1422/2851] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:10.409942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.412486 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:10.482321 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a098-4434-48f2-80c3-025eec0f504b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.486438 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.487049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.487323 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.487589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.498015 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.499465 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113830-2d4e-4bfd-9e7f-6b313d206e97 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.509338 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1430/2852] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:10.541540 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.604100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23a028-8c8e-4558-a3e1-03b67f304a32 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.609338 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.609975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.610252 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.610529 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] PATH_INFO: `/v3/users/5b51e2c868fd4d379f2143635d5cacf4` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.611717 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b51e2c868fd4d379f2143635d5cacf4)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.613693 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.672875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b51e2c868fd4d379f2143635d5cacf4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:10.684806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b51e2c868fd4d379f2143635d5cacf4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:10.685505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b51e2c868fd4d379f2143635d5cacf4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:10.692303 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b51e2c868fd4d379f2143635d5cacf4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:10.692969 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b51e2c868fd4d379f2143635d5cacf4'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:10.706909 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1423/2853] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:10 2022] DELETE /identity/v3/users/5b51e2c868fd4d379f2143635d5cacf4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:10.711787 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.712258 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.712358 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.732147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:10.733540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:10.789747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:10.801511 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1431/2854] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:10.811711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:10.813220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:10.873231 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21e5dc-d0c3-41ca-8c57-150f787c14ed admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:10.877037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:10.877645 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:10.877918 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:10.878181 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:10.887981 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:10.889432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:10.899394 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1424/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:11.198412 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:11.199967 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:11.212727 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbe81d-b3f8-4f06-80b0-84f51462f2ac None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:11.218044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:11.218681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.218956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.219242 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] PATH_INFO: `/v3/projects/7b4e7e1adfa44b9bafdf9623febe19db` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:11.220687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4e7e1adfa44b9bafdf9623febe19db)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:11.223388 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:11.277751 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4e7e1adfa44b9bafdf9623febe19db', 'request_id': 'req-7b61dbee-428d-44a3-a132-c284c5d8b7a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.283426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4e7e1adfa44b9bafdf9623febe19db', 'request_id': 'req-7b61dbee-428d-44a3-a132-c284c5d8b7a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.291941 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4e7e1adfa44b9bafdf9623febe19db', 'request_id': 'req-7b61dbee-428d-44a3-a132-c284c5d8b7a9'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.303626 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] The token cache is being invalidate because project 7b4e7e1adfa44b9bafdf9623febe19db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:11.303913 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.304887 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.306505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1432/2856] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:11 2022] DELETE /identity/v3/projects/7b4e7e1adfa44b9bafdf9623febe19db => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:11.310737 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:11.321869 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad65-d77d-4cc4-ad0c-b8622f84fe95 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:11.334927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:11.385523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:11.386152 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.386445 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.386711 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] PATH_INFO: `/v3/users/363dd166318f4d81a5db5d9eff1b3683` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:11.387890 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363dd166318f4d81a5db5d9eff1b3683)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:11.389863 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:11.441073 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363dd166318f4d81a5db5d9eff1b3683'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.459867 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363dd166318f4d81a5db5d9eff1b3683'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.460790 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363dd166318f4d81a5db5d9eff1b3683'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.468852 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363dd166318f4d81a5db5d9eff1b3683'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.469583 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-5beffbf9-0d3c-4bf5-bcff-f5700c818e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363dd166318f4d81a5db5d9eff1b3683'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.484959 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1425/2857] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:11 2022] DELETE /identity/v3/users/363dd166318f4d81a5db5d9eff1b3683 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:11.804940 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:11.806250 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:11.825233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61dbee-428d-44a3-a132-c284c5d8b7a9 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:11.888693 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:11.889717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.890227 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.890669 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] PATH_INFO: `/v3/projects/f67b2a7b18ad451584f23c942941b1ba` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:11.892490 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67b2a7b18ad451584f23c942941b1ba)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:11.895549 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:11.953724 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67b2a7b18ad451584f23c942941b1ba', 'request_id': 'req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.959709 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67b2a7b18ad451584f23c942941b1ba', 'request_id': 'req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.969770 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67b2a7b18ad451584f23c942941b1ba', 'request_id': 'req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.982154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] The token cache is being invalidate because project f67b2a7b18ad451584f23c942941b1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:11.982472 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.983066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-e2c1915d-cd7f-4ef2-80e1-9d2f7780ab67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:11.984586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1433/2858] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:11 2022] DELETE /identity/v3/projects/f67b2a7b18ad451584f23c942941b1ba => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:11.989871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:11.990361 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:11.990485 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.011673 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:12.012912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:12.082929 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1426/2859] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:12.091718 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.091969 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.092268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.121857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:12.123208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:12.133261 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1434/2860] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:12.137974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.150113 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff6aab-660f-4601-8b6a-92548da9f9b0 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.155806 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.156452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.156736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.157005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.157660 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:12.157964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.159585 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.176382 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1427/2861] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:12.182279 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.191884 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43872f0c-3c22-464d-96c7-b909cdcc2080 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.199026 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.199615 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.199885 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.200149 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.200819 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.202722 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.207728 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:12.235178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1435/2862] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:12.239780 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.252225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73378b8d-e2bf-4572-a3f8-43cecaf1989f admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.279495 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:12.322543 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.323144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.323421 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.323692 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.324332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.326286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.351940 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1428/2863] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:38:12.355900 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.367706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c988c0e-3139-40cf-9d42-f8730a578250 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.373158 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.373759 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.374033 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.374274 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.374949 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.376631 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.387389 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1436/2864] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:12.391581 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.403136 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2bcb2-0459-49da-8ed4-a45bf91cf242 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.410010 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.410892 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.411298 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.411698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.412727 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.415333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478296e-5ed8-4cc0-ad4f-58755d13ff55 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.432163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1429/2865] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:12.437013 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.451735 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4bb3-974f-4765-8c95-40b177ded42b admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.457208 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.457883 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.458140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.458402 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] PATH_INFO: `/v3/projects/3649f97bf2ae4325a6d49d74d290d923/users/33420d03d42a4e769585dc55ab87b052/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.474312 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3649f97bf2ae4325a6d49d74d290d923, user_id=33420d03d42a4e769585dc55ab87b052, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.477716 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.492760 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1437/2866] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:12 2022] PUT /identity/v3/projects/3649f97bf2ae4325a6d49d74d290d923/users/33420d03d42a4e769585dc55ab87b052/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:12.505341 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.505858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.505858 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.542912 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] MFA Rules not processed for user `33420d03d42a4e769585dc55ab87b052`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:12.544180 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:12.614291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1430/2867] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:12.622251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.697197 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f3e1-28d2-49bc-8506-f968a773ddf3 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.704088 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.704739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.705005 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.705264 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.705874 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.707831 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.739083 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1438/2868] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:12.744125 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.759193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4b46-79c7-48e7-9af7-530ac64e66ce None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.830238 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.830835 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.831084 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.831346 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.831984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.834157 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.858233 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1431/2869] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:12 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:12.862339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.873461 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a916291-32d9-43ca-a2a2-496387045c35 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.878915 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.879515 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.879790 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.880048 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.880719 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.882333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.894171 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1439/2870] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:12.898925 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.909020 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d2e6-c258-4f4d-8e7f-7980f0281939 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:12.914256 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:12.914963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:12.915225 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:12.915501 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] PATH_INFO: `/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68/users/64f232fb5c8147c8a3c092e6c56e68b5/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:12.931441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbe61c05aa4fa1aa60b4c0dabded68, user_id=64f232fb5c8147c8a3c092e6c56e68b5, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:12.934214 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:12.943313 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:12.950468 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1432/2871] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:12 2022] PUT /identity/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68/users/64f232fb5c8147c8a3c092e6c56e68b5/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:38:12.954625 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:12.965839 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e270fe6-815d-47cb-bcdf-6117927ec8f7 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:13.030251 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:13.030859 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:13.031130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:13.031392 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:13.032032 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:13.033668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccdfc3-e59e-4132-860f-992d02441582 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:13.046561 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1440/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:13.051022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:13.068987 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff0d1-08a3-4ee7-9f10-f2bf2c3f78c0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:13.076315 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:13.077387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:13.077864 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:13.078368 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] PATH_INFO: `/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68/users/64f232fb5c8147c8a3c092e6c56e68b5/roles/094fcef4654043758d8a01fad877074a` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:13.080974 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbe61c05aa4fa1aa60b4c0dabded68, user_id=64f232fb5c8147c8a3c092e6c56e68b5, role_id=094fcef4654043758d8a01fad877074a)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:13.083614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:13.095519 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1433/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:13 2022] PUT /identity/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68/users/64f232fb5c8147c8a3c092e6c56e68b5/roles/094fcef4654043758d8a01fad877074a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:13.106771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:13.107039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:13.107443 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:13.139681 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] MFA Rules not processed for user `64f232fb5c8147c8a3c092e6c56e68b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:13.140871 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:13.150421 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:13.228034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1441/2874] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:13.239241 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:13.241203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:13.317262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff3eb-251e-4daf-9057-514e43379f05 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:13.322375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:13.323369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:13.323369 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:13.323617 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:13.418641 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:13.419993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:13.431058 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1434/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:17.726555 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:17.728192 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:17.754514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863bd1-521a-4004-9131-2ae904ca03f9 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:17.759356 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:17.759981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:17.760257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:17.760546 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:17.777843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:17.779273 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2165-bc0e-4b27-a478-4303384e1292 service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:17.789666 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1442/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:22.709400 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:22.776677 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1716c-8d75-4def-94e1-0fe50e1c5869 service cinder] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:22.781879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:22.782517 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:22.782797 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:22.783068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] PATH_INFO: `/v3/users/33420d03d42a4e769585dc55ab87b052` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:22.784239 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33420d03d42a4e769585dc55ab87b052)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:22.786432 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:22.818955 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:22.838821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33420d03d42a4e769585dc55ab87b052'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:22.851514 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33420d03d42a4e769585dc55ab87b052'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:22.852234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33420d03d42a4e769585dc55ab87b052'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:22.860902 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33420d03d42a4e769585dc55ab87b052'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:22.861638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33420d03d42a4e769585dc55ab87b052'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:22.880788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1435/2877] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:22 2022] DELETE /identity/v3/users/33420d03d42a4e769585dc55ab87b052 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:22.885575 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:22.886102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:22.886102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:22.906102 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:22.907304 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:22.972012 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1443/2878] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:22.986851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:22.988589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.061068 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406308c0-f301-42b0-9490-9db521917f10 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.064814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.065428 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.065698 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.065967 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.075957 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.077387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.087270 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1436/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:23.367136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.368587 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.380938 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240aa66-bfa2-4078-af7b-5e918fdec038 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.386616 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.387257 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.387523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.387905 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] PATH_INFO: `/v3/projects/3649f97bf2ae4325a6d49d74d290d923` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.389176 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3649f97bf2ae4325a6d49d74d290d923)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.391151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.444699 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3649f97bf2ae4325a6d49d74d290d923', 'request_id': 'req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.451433 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3649f97bf2ae4325a6d49d74d290d923', 'request_id': 'req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.461318 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3649f97bf2ae4325a6d49d74d290d923', 'request_id': 'req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.471838 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:23.476501 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] The token cache is being invalidate because project 3649f97bf2ae4325a6d49d74d290d923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:23.476721 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.477911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.479956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1444/2880] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:23 2022] DELETE /identity/v3/projects/3649f97bf2ae4325a6d49d74d290d923 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:23.485161 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.495710 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1e75-0806-4cbb-a98d-c23622da8f40 service neutron] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:23.556612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:23.557389 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:23.557764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:23.558134 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] PATH_INFO: `/v3/users/64f232fb5c8147c8a3c092e6c56e68b5` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:23.559405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f232fb5c8147c8a3c092e6c56e68b5)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:23.561385 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:23.612023 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f232fb5c8147c8a3c092e6c56e68b5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.614047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:23.626685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f232fb5c8147c8a3c092e6c56e68b5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.627828 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f232fb5c8147c8a3c092e6c56e68b5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.635751 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f232fb5c8147c8a3c092e6c56e68b5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.636474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-481fa6be-8f4e-4329-bc26-d542354404c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f232fb5c8147c8a3c092e6c56e68b5'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:23.650709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1437/2881] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:23 2022] DELETE /identity/v3/users/64f232fb5c8147c8a3c092e6c56e68b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:23.951912 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:23.953475 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:23.967144 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80a9f7-fa82-48fa-b0ce-024f57ad31ac admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.027267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.027807 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.028081 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.028327 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] PATH_INFO: `/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.029493 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdbe61c05aa4fa1aa60b4c0dabded68)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.031393 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.083988 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdbe61c05aa4fa1aa60b4c0dabded68', 'request_id': 'req-89b38a3a-f199-4405-bc34-26b31bd8b34b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.089879 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdbe61c05aa4fa1aa60b4c0dabded68', 'request_id': 'req-89b38a3a-f199-4405-bc34-26b31bd8b34b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.098091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdbe61c05aa4fa1aa60b4c0dabded68', 'request_id': 'req-89b38a3a-f199-4405-bc34-26b31bd8b34b'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.110298 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] The token cache is being invalidate because project bfdbe61c05aa4fa1aa60b4c0dabded68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:24.110578 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.111295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-89b38a3a-f199-4405-bc34-26b31bd8b34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:24.112914 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1445/2882] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:23 2022] DELETE /identity/v3/projects/bfdbe61c05aa4fa1aa60b4c0dabded68 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:24.119403 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.119927 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.120059 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.140219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:24.141571 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.202999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1438/2883] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:24.212239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.212557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.212857 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.233291 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:24.234505 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.243293 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1446/2884] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:24.249899 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.262164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e3cc-ee6a-4b6f-9c1a-c19da8682d3f None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.269173 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.270065 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.270458 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.270844 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.271834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:24.272271 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.274488 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.286776 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1439/2885] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:38:24.292696 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.303476 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303fcb-aaa6-4f62-8d27-9cc3463fc03c None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.310648 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.311249 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.311523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.311785 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.312499 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.314504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.345076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1447/2886] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:24.350156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.361508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c01a-3386-4c5b-8035-23e8cbf97810 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.434206 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.434814 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.435087 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.435356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.435983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.437983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.461515 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1440/2887] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:24.465779 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.476791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72165acd-3413-40aa-b538-4faf325f803f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.482361 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.482963 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.483229 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.483489 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.484132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.485762 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.496442 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1448/2888] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:24.500676 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.511474 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bab8a-32e7-4f86-a570-5a6d8c097a54 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.516610 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.517219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.517496 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.517768 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.518414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.520018 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0eaca1-e7f0-4b28-bf7a-b15b01f6452c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.530961 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1441/2889] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:24.535477 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.547890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ac6f-5cd1-4225-b1e7-29ba01843d5c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.553484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.554177 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.554439 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.554676 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] PATH_INFO: `/v3/projects/ec46fce994c844ffba1ffd27df02d758/users/6717bfb6f0004ba68868c755c9a93c31/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.571645 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec46fce994c844ffba1ffd27df02d758, user_id=6717bfb6f0004ba68868c755c9a93c31, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.574330 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.588869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1449/2890] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:24 2022] PUT /identity/v3/projects/ec46fce994c844ffba1ffd27df02d758/users/6717bfb6f0004ba68868c755c9a93c31/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:24.656736 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.657009 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.657297 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.686219 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] MFA Rules not processed for user `6717bfb6f0004ba68868c755c9a93c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:24.687437 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.708624 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:24.757424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1442/2891] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:24.773346 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.775458 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:24.809942 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:24.843288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f228-bb7e-472c-be22-a23ae73d2cce admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.849018 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.849775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.850135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.850441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.861586 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.863065 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5d393-1681-4ddf-b3dc-2f488b49787e service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:24.873091 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1450/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:24.896763 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:24.971919 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7d39-4ee4-409b-87df-287c0da6f649 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:24.979674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:24.979674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:24.979674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:24.979674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] PATH_INFO: `/v3/users/6717bfb6f0004ba68868c755c9a93c31` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:24.980167 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6717bfb6f0004ba68868c755c9a93c31)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:24.981818 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.033492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6717bfb6f0004ba68868c755c9a93c31'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.046335 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6717bfb6f0004ba68868c755c9a93c31'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.047177 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6717bfb6f0004ba68868c755c9a93c31'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.055119 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6717bfb6f0004ba68868c755c9a93c31'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.055826 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6717bfb6f0004ba68868c755c9a93c31'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.070527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1443/2893] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:24 2022] DELETE /identity/v3/users/6717bfb6f0004ba68868c755c9a93c31 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:25.075285 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.075810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.075810 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.096768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:25.098687 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.174795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1451/2894] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:25.185116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.186685 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.233580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:25.250122 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40aef-3231-42b1-a5c9-64010ed6c517 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.254523 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.255166 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.255441 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.255705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.266593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.268046 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d949f-823f-4058-8317-6e042a5f1c4a service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.278201 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1444/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:25.567278 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.569271 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.587348 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920b499-1780-40e8-a7f9-7de47a03f3ae None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.592365 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.593142 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.593416 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.593652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] PATH_INFO: `/v3/projects/ec46fce994c844ffba1ffd27df02d758` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.595529 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec46fce994c844ffba1ffd27df02d758)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.597617 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.649085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec46fce994c844ffba1ffd27df02d758', 'request_id': 'req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.654849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec46fce994c844ffba1ffd27df02d758', 'request_id': 'req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.663563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec46fce994c844ffba1ffd27df02d758', 'request_id': 'req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.675256 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] The token cache is being invalidate because project ec46fce994c844ffba1ffd27df02d758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:25.675545 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.676254 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-61a7dd7f-da10-4810-b6d0-2bca6e0c2faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:25.677890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1452/2896] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:25 2022] DELETE /identity/v3/projects/ec46fce994c844ffba1ffd27df02d758 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:25.684163 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.684508 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.684785 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.706456 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:25.707705 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.772410 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1445/2897] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:25.780295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.780601 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.780869 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.803747 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:25.804989 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:25.813449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1453/2898] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:25.818413 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.829030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd451-0734-4f61-a63e-a5e2599f2715 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.833650 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.834254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.834533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.834994 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.835646 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:25.835949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.837669 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.849380 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1446/2899] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:25.855563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.865425 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6bdab-ac69-4485-ac05-2b4ad5401599 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.870246 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.870837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.871108 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.871369 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.872007 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.873930 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:25.908589 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1454/2900] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:25 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:25.913573 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:25.924775 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876d85-0c41-4555-9f16-b2bc25053ddc admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:25.988541 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:25.989203 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:25.989487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:25.989764 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:25.990402 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:25.992492 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.015095 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1447/2901] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:25 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:26.020054 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.031029 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e711ff-8171-4b80-aa94-c15c3bf66051 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.037301 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.038380 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.038697 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.039004 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.039679 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.041322 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.051866 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1455/2902] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:26.056194 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.071014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff4538-fd74-4f9c-962e-a5ad5e1acc95 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.076939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.077580 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.077861 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.078135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.078834 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.080490 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466c25-c51b-48a7-8f11-eb03ef0690d8 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.092489 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1448/2903] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:26.096878 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.109523 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf96c-64b9-480a-bf6e-c761e825dd34 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.118877 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.120619 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.121339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.122143 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] PATH_INFO: `/v3/projects/053657bee1ef423aac0d92e62ab25439/users/44c2ce9ef3e049c689b919ba453fc457/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.142467 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:26.148460 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053657bee1ef423aac0d92e62ab25439, user_id=44c2ce9ef3e049c689b919ba453fc457, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.151382 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.168675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1456/2904] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:26 2022] PUT /identity/v3/projects/053657bee1ef423aac0d92e62ab25439/users/44c2ce9ef3e049c689b919ba453fc457/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:26.179207 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.179484 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.179750 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.211989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] MFA Rules not processed for user `44c2ce9ef3e049c689b919ba453fc457`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:26.213237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:26.256629 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:26.284104 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1449/2905] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:26.298986 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:26.301520 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:26.389132 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0222ec-fb67-4868-89bc-504a5bf3fd25 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:26.392994 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7eb4d9e0f94dd98f3ac4790c63e540', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:26.393891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:26.393891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:26.393891 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:26.406449 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:26.407898 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d2df-3c9e-4fb6-b2e8-2495f5d31a6b service glance] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:26.418140 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1457/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:36.281135 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=9 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:36.413399 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:46.327226 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:46.402944 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e123-5046-47fd-97d6-1c5857a33b88 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:46.408875 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:46.409666 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:46.410003 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:46.410376 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] PATH_INFO: `/v3/users/44c2ce9ef3e049c689b919ba453fc457` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:46.411853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2ce9ef3e049c689b919ba453fc457)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:46.414566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:46.467144 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2ce9ef3e049c689b919ba453fc457'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:46.481008 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2ce9ef3e049c689b919ba453fc457'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:46.481760 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2ce9ef3e049c689b919ba453fc457'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:46.489871 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2ce9ef3e049c689b919ba453fc457'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:46.491056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2ce9ef3e049c689b919ba453fc457'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:46.508788 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1450/2907] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:38:46 2022] DELETE /identity/v3/users/44c2ce9ef3e049c689b919ba453fc457 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:46.514639 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:46.515164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:46.515164 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:46.535238 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:46.536463 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:46.603773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1458/2908] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:46.619320 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:46.621196 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:46.711980 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d3cd5-dcb3-4bc1-ac3c-fe1f4919b93b admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:46.716137 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:46.717061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:46.717521 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:46.717975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:46.727951 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:46.731129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20876-fd87-4d2c-9d46-e0f9b019db36 service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:46.747631 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1451/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:47.047061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.048804 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:47.062837 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cffd22-4def-44fd-a779-9f0716589969 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.069436 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.070239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.070568 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.070842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] PATH_INFO: `/v3/projects/053657bee1ef423aac0d92e62ab25439` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.072198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053657bee1ef423aac0d92e62ab25439)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.074352 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.126303 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053657bee1ef423aac0d92e62ab25439', 'request_id': 'req-75777d36-6a06-4b78-9055-3f2b48dde540'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:47.132113 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053657bee1ef423aac0d92e62ab25439', 'request_id': 'req-75777d36-6a06-4b78-9055-3f2b48dde540'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:47.140889 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053657bee1ef423aac0d92e62ab25439', 'request_id': 'req-75777d36-6a06-4b78-9055-3f2b48dde540'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:47.153121 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] The token cache is being invalidate because project 053657bee1ef423aac0d92e62ab25439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:38:47.153426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:47.154129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-75777d36-6a06-4b78-9055-3f2b48dde540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:38:47.155657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1459/2910] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:38:47 2022] DELETE /identity/v3/projects/053657bee1ef423aac0d92e62ab25439 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:47.160781 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.161061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.161330 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.186913 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:47.188254 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:47.209612 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:47.255638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1452/2911] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:47.264056 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.264434 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.264763 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.287228 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:47.288605 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:47.297231 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1460/2912] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:47.301970 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.312063 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bd676-948d-4cdb-9bb6-8bc8c7e8c0ab None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.316894 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.317497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.317779 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.318051 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.318821 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81650) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:38:47.319076 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.321014 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.333005 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1453/2913] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:38:47.338053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.349035 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0856dc9-d51d-4577-9ea3-8030248403e6 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.355730 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.356638 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.357034 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.357313 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.357956 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.359925 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.394692 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1461/2914] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:38:47 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:47.399853 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.413528 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3219a-8500-4f60-87a0-bdac66543cd0 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.475375 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.475983 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.476264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.476572 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] PATH_INFO: `/v3/users` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.477204 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.479156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.502351 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1454/2915] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:38:47 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:38:47.507059 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.519554 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd45cf-4b7f-4313-9594-9b3d6a96f839 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.526008 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.526741 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.527074 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.527371 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.528092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.529890 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.541703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1462/2916] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:47.545966 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.556473 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959c8e5-b2e4-448e-86fd-30c3990d19ed admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.561281 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.561900 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.562179 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.562482 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.563116 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.564758 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41296c05-086c-4aef-88b7-0c016ca986c6 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.576140 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1455/2917] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:38:47.580570 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.592129 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8734a-af8b-4de8-a572-1b112c1da674 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.597036 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.597646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.597950 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.598207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] PATH_INFO: `/v3/projects/7dc89e159c374acf8e40c418deb49908/users/32c73e67555e4ec188ab06a15c3eefa7/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.614518 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc89e159c374acf8e40c418deb49908, user_id=32c73e67555e4ec188ab06a15c3eefa7, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.617479 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.633151 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1463/2918] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:38:47 2022] PUT /identity/v3/projects/7dc89e159c374acf8e40c418deb49908/users/32c73e67555e4ec188ab06a15c3eefa7/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:38:47.638597 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dca670-6d35-466a-b9fc-c52ea2fa3cbb None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.638881 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dca670-6d35-466a-b9fc-c52ea2fa3cbb None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.639154 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dca670-6d35-466a-b9fc-c52ea2fa3cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.658388 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-16dca670-6d35-466a-b9fc-c52ea2fa3cbb None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:47.659497 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-16dca670-6d35-466a-b9fc-c52ea2fa3cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:47.733812 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1456/2919] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:38:47.744657 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:47.746609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:47.773823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:47.812010 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488b946-0771-4e83-a290-a37c78ec45f1 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:47.815796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:47.816484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:47.816484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:47.816484 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:47.827170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:47.828703 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:47.839685 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1464/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:48.545703 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fca1-e353-4a91-bc22-bd99dbef1828 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:48.546261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fca1-e353-4a91-bc22-bd99dbef1828 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:48.546261 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772fca1-e353-4a91-bc22-bd99dbef1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:48.582325 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-8772fca1-e353-4a91-bc22-bd99dbef1828 None None] MFA Rules not processed for user `32c73e67555e4ec188ab06a15c3eefa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:48.583566 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-8772fca1-e353-4a91-bc22-bd99dbef1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:48.602419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:38:48.657546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1457/2921] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:48.672629 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:48.674668 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:48.744259 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb068-a997-4f97-8da1-5283045f8e39 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:48.748825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:48.749482 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:48.749782 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:48.750085 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:48.760695 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:48.762308 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:48.775680 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1465/2922] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:50.162589 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.163164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.163164 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.183118 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] MFA Rules not processed for user `32c73e67555e4ec188ab06a15c3eefa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:38:50.184340 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.192795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1458/2923] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:38:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:38:50.445773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:50.457677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241362c-5ac1-43d2-8908-8c4d4e87862d service cinder] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:50.461860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:50.462426 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:50.462694 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:50.462957 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:50.464704 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:50.474296 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:50.475829 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:50.484441 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1466/2924] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:38:52.745332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:38:52.747632 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.765745 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ec45c-39bb-44e5-ac11-80b9a8e87cf1 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:38:52.772664 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:38:52.773362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:38:52.773719 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:38:52.774061 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:38:52.776237 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:38:52.788294 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:38:52.789939 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe81cb9-e74b-460e-8578-f92d98cd102c service neutron] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:38:52.799975 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1459/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:00.480581 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=49 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:02.795272 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=28 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:06.782574 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:06.784288 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:06.888977 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420bdde-d409-4911-ac63-f887e1f9bec5 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:06.894637 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2512318b0a854bd2934befc3de218102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:06.895267 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:06.895644 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:06.895974 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:06.897828 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:06.911999 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:06.913650 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:06.928370 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1467/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:08.106935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c12d-06cb-4fa8-925a-0517f8756522 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:08.107463 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c12d-06cb-4fa8-925a-0517f8756522 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:08.107584 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c12d-06cb-4fa8-925a-0517f8756522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:08.130156 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-61c2c12d-06cb-4fa8-925a-0517f8756522 None None] MFA Rules not processed for user `32c73e67555e4ec188ab06a15c3eefa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:08.131638 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-61c2c12d-06cb-4fa8-925a-0517f8756522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:08.139905 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1460/2927] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:39:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:08.396677 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:08.417098 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa620660-d2b0-4fef-882b-e6954251ee8a service nova] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:08.421305 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:08.421911 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:08.422188 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:08.422455 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:08.424268 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:08.450504 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:08.452266 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:08.464781 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1468/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:18.124367 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:18.459771 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=58 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:31.237409 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f0d5-b377-45a4-b498-84e506fc6672 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.237860 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f0d5-b377-45a4-b498-84e506fc6672 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.237977 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807f0d5-b377-45a4-b498-84e506fc6672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.268151 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-5807f0d5-b377-45a4-b498-84e506fc6672 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:31.269372 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-5807f0d5-b377-45a4-b498-84e506fc6672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:31.324984 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1461/2929] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Aug 29 20:39:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:31.373178 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:31.374661 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:31.450548 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf42f-f6a7-4f1b-b69c-c4cf229d05f1 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:31.456167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:31.456806 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:31.457076 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:31.457343 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:31.466398 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:31.468044 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:31.476507 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1469/2930] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:41.317846 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=29 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:41.472995 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=32 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:46.824885 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.825405 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.825518 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.847989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] MFA Rules not processed for user `e6160c9f7ca04f579b99202118032eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:46.849989 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:46.859295 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1462/2931] 10.222.0.20 () {58 vars in 967 bytes} [Mon Aug 29 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:46.872791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:46.884544 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b8cde-85c0-49ba-b12d-49d239c7313d service swift] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:46.891464 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d2583f38c13417887002a80c64654bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:46.892068 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:46.892335 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:46.892628 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:46.902367 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:46.904024 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:46.913077 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1470/2932] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Aug 29 20:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:39:48.825229 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:48.826963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:48.887295 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:48.901563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e901ed-9734-46eb-9d28-aadeac54051d service swift] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:48.907823 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:48.909137 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:48.909567 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:48.909862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] PATH_INFO: `/v3/users/32c73e67555e4ec188ab06a15c3eefa7` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:48.911282 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c73e67555e4ec188ab06a15c3eefa7)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:48.914243 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:48.915735 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ca136-9f30-48d3-8844-f5b70e3e7721 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:48.921032 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:48.921662 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:48.921917 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:48.922191 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:48.923993 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:48.937220 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:48.938866 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:48.950949 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1463/2933] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:39:48.975100 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c73e67555e4ec188ab06a15c3eefa7'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:48.984094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c73e67555e4ec188ab06a15c3eefa7'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:48.992336 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c73e67555e4ec188ab06a15c3eefa7'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:48.993078 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c73e67555e4ec188ab06a15c3eefa7'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.006269 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-fa8961e8-2add-48a3-982b-0c879b9db460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c73e67555e4ec188ab06a15c3eefa7'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.013351 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1471/2934] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:39:48 2022] DELETE /identity/v3/users/32c73e67555e4ec188ab06a15c3eefa7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:49.197016 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.208100 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88970e5-a365-46c6-a2c4-1580dc5f7d33 service placement] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.274243 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.274915 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.275195 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.275465 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] PATH_INFO: `/v3/projects/7dc89e159c374acf8e40c418deb49908` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.276723 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc89e159c374acf8e40c418deb49908)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.278665 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.327999 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc89e159c374acf8e40c418deb49908', 'request_id': 'req-c49532cb-a662-4e25-a5de-223f6c28ff3e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.335129 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc89e159c374acf8e40c418deb49908', 'request_id': 'req-c49532cb-a662-4e25-a5de-223f6c28ff3e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.344478 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc89e159c374acf8e40c418deb49908', 'request_id': 'req-c49532cb-a662-4e25-a5de-223f6c28ff3e'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.360436 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] The token cache is being invalidate because project 7dc89e159c374acf8e40c418deb49908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:39:49.360893 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.361709 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-c49532cb-a662-4e25-a5de-223f6c28ff3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:39:49.363708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1464/2935] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:39:49 2022] DELETE /identity/v3/projects/7dc89e159c374acf8e40c418deb49908 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:39:49.369239 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.369526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.369795 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.401147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:49.402376 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:49.469720 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1472/2936] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:49.479527 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.479868 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.480291 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.502586 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:49.503810 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:49.513356 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1465/2937] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:39:49.517814 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.528775 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53b92-5256-41aa-abd2-c23dc27473a7 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.534797 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.535622 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.536107 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.536595 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.537532 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:39:49.537964 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.539968 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.556827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1473/2938] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:39:49.561802 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.573047 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150d450-ba96-4e61-87f0-b455cf096b9c None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.578817 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.580246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.580246 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.580674 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.581854 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.585348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.597754 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:49.634880 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1466/2939] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:39:49 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:49.639557 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.650469 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f074859-e5e6-4f1c-aa0f-ad024771de59 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.687134 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:39:49.713037 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.713652 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.713909 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.714170 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.714796 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.716773 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.743427 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1474/2940] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:39:49 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:39:49.745304 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.759150 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e49b-645e-42b6-acae-26a6d3274f87 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.764533 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.765158 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.765439 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.765708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.766362 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.767978 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.779070 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1467/2941] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:39:49.783349 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.794049 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679dac-64ca-4fca-9094-5a75717065b2 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.799127 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.800092 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.800375 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.800684 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.801325 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.802933 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3071b-5f81-4850-837a-ca8d9474e56a admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.813981 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1475/2942] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:39:49.818963 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:49.833332 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886c68-1269-451e-954c-65b4eb9513a5 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:49.840879 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:49.841691 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.842030 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.842398 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] PATH_INFO: `/v3/projects/d5deb8dafadb49ce840e26638270c864/users/b4eff972b8464f30807cf50411445b6f/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.859636 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5deb8dafadb49ce840e26638270c864, user_id=b4eff972b8464f30807cf50411445b6f, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:49.862333 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:49.878595 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1468/2943] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:39:49 2022] PUT /identity/v3/projects/d5deb8dafadb49ce840e26638270c864/users/b4eff972b8464f30807cf50411445b6f/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:39:49.891776 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:49.892339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:49.892339 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:49.923023 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] MFA Rules not processed for user `b4eff972b8464f30807cf50411445b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:39:49.924418 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:50.008379 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1476/2944] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:39:50.022269 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:39:50.024037 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:39:50.094387 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde711c6-b728-433a-8e3c-536de38f8f91 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:39:50.099169 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:39:50.099795 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:39:50.100075 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:39:50.100348 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:39:50.110079 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:39:50.111524 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbd499-69cf-463e-8537-34df4eb8912b service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:39:50.121022 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1469/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:00.005053 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:00.116546 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:00.444315 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:00.534136 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f8ae-5e7d-4579-9ed4-e117a22092e4 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:00.539514 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:00.540207 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:00.540502 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:00.540772 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] PATH_INFO: `/v3/users/b4eff972b8464f30807cf50411445b6f` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:00.541904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4eff972b8464f30807cf50411445b6f)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:00.543833 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:00.595753 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4eff972b8464f30807cf50411445b6f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:00.606133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4eff972b8464f30807cf50411445b6f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:00.613584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4eff972b8464f30807cf50411445b6f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:00.614216 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4eff972b8464f30807cf50411445b6f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:00.626846 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4eff972b8464f30807cf50411445b6f'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:00.633417 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1477/2946] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:00 2022] DELETE /identity/v3/users/b4eff972b8464f30807cf50411445b6f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:00.638193 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:00.638483 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:00.638755 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:00.673199 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:00.674430 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:00.748345 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1470/2947] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:40:00.758791 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:00.759983 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:00.828123 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d1dbf-881f-4a91-8297-aa23bf97340c admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:00.832198 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:00.832847 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:00.833126 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:00.833414 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:00.843966 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:00.845509 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476817b-45be-4497-b814-2836720cf52f service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:00.856260 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1478/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:01.151460 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.152992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.165487 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c06110-9385-4b90-99e7-d66a9ece6810 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.171172 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.171851 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.172127 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.172364 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] PATH_INFO: `/v3/projects/d5deb8dafadb49ce840e26638270c864` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.173668 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5deb8dafadb49ce840e26638270c864)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.175635 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.226143 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5deb8dafadb49ce840e26638270c864', 'request_id': 'req-150302c2-04b3-4e32-ad2b-5dd53248ab2b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.232331 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5deb8dafadb49ce840e26638270c864', 'request_id': 'req-150302c2-04b3-4e32-ad2b-5dd53248ab2b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.240001 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5deb8dafadb49ce840e26638270c864', 'request_id': 'req-150302c2-04b3-4e32-ad2b-5dd53248ab2b'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.251424 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] The token cache is being invalidate because project d5deb8dafadb49ce840e26638270c864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:01.251714 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.252353 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-150302c2-04b3-4e32-ad2b-5dd53248ab2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:01.254262 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1471/2949] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:01 2022] DELETE /identity/v3/projects/d5deb8dafadb49ce840e26638270c864 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:01.259717 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.260233 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.260337 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.269646 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:01.282768 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:01.284945 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.348526 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1479/2950] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:01.360997 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.361282 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.361556 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.382708 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:01.383935 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.393762 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1472/2951] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:01.399119 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.409922 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbee1c-802c-43bd-8233-1508b3ab47de None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.415559 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.416154 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.416424 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.416701 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] PATH_INFO: `/v3/domains` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.417350 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:40:01.417641 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.419230 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.432070 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1480/2952] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Aug 29 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:40:01.436614 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.447264 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4532f0f-d6d5-45b4-8776-63f29d8a0f32 None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.452649 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.453259 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.453532 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.453794 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.454419 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.456327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.490964 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1473/2953] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:40:01.496066 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.507195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817409-e112-4425-af87-ad45a6683654 admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.568904 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.569563 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.569862 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.570133 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] PATH_INFO: `/v3/users` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.570815 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.572936 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.598849 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1481/2954] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:40:01.604234 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.616209 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b1622-01d2-48a1-9c47-b5e5fd2058c7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.623162 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.623786 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.624062 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.624505 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.625031 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.626678 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.637820 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1474/2955] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:01.642047 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.653654 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cfe0-d2d2-4e7d-b4d5-7901c86fbf3f admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.659378 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.660195 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.660540 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.660805 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.661538 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.663205 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355bd60-b009-4598-ad43-e4fe4d70d649 admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.674852 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1482/2956] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Aug 29 20:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:40:01.679833 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.690932 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d25ee-b5f4-40ac-89f5-e4039bdbe768 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.696937 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.697593 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.697870 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.698160 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] PATH_INFO: `/v3/projects/88943591a13b49d7a62984131861ffca/users/2199dea0b7c14de1b5a2ce9ea9787c7e/roles/7b370c51ccfb42a3817e8b6aca7d0483` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.714197 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88943591a13b49d7a62984131861ffca, user_id=2199dea0b7c14de1b5a2ce9ea9787c7e, role_id=7b370c51ccfb42a3817e8b6aca7d0483)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.716887 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.731067 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1475/2957] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Aug 29 20:40:01 2022] PUT /identity/v3/projects/88943591a13b49d7a62984131861ffca/users/2199dea0b7c14de1b5a2ce9ea9787c7e/roles/7b370c51ccfb42a3817e8b6aca7d0483 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:01.741765 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] REQUEST_METHOD: `POST` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.742039 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.742306 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.770948 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.auth.core [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] MFA Rules not processed for user `2199dea0b7c14de1b5a2ce9ea9787c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:01.772283 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.851789 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:01.856130 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1483/2958] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:01.868168 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:01.869948 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:01.881539 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:01.935117 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de8e7-658e-4333-8f2a-0817da6aefd7 admin admin] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:01.939452 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ae38cdd87144379c63a95dfa9bb9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:01.941457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] REQUEST_METHOD: `GET` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:01.941457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:01.941457 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:01.960327 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:01.961856 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad231-ac24-4d08-a538-9d910ffcdb02 service cinder] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:01.971991 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1476/2959] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:07.057825 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.127202 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce6ba-18fe-4c7e-a8da-b907462ec474 None None] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.132547 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.133204 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.133480 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.133746 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] PATH_INFO: `/v3/users/2199dea0b7c14de1b5a2ce9ea9787c7e` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.134888 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2199dea0b7c14de1b5a2ce9ea9787c7e)` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.136860 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.197706 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2199dea0b7c14de1b5a2ce9ea9787c7e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.207675 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2199dea0b7c14de1b5a2ce9ea9787c7e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.217094 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2199dea0b7c14de1b5a2ce9ea9787c7e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.217767 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2199dea0b7c14de1b5a2ce9ea9787c7e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.231713 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.notifications [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2199dea0b7c14de1b5a2ce9ea9787c7e'} {{(pid=81651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.237739 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1484/2960] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Aug 29 20:40:07 2022] DELETE /identity/v3/users/2199dea0b7c14de1b5a2ce9ea9787c7e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:07.242414 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] REQUEST_METHOD: `POST` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.243212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.243212 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.275502 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.auth.core [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] MFA Rules not processed for user `f8200bcf27da433fa27fff3a3ac11f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81650) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:40:07.276789 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.341286 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1477/2961] 10.222.0.20 () {58 vars in 958 bytes} [Mon Aug 29 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:40:07.351585 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.354199 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.416991 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a8b5-e501-4e5c-adcf-f4dc9e692f3e admin admin] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.421147 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3846eb00ef4876952addbc1b1d1902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.421827 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.422061 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.422333 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.434167 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.435606 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.446536 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1485/2962] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:40:07.719607 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] Authenticating user token {{(pid=81650) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:40:07.721434 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.fernet_utils [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81650) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:40:07.735024 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e81d32-9242-4304-bfa4-d46b95013c3e None None] Validating token access rules against request {{(pid=81650) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:40:07.741339 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8200bcf27da433fa27fff3a3ac11f6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02370ea83738498ab52b54a7db5f2ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81650) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:40:07.741992 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:40:07.742278 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:40:07.742551 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] PATH_INFO: `/v3/projects/88943591a13b49d7a62984131861ffca` {{(pid=81650) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:40:07.743702 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88943591a13b49d7a62984131861ffca)` {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:40:07.745686 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] RBAC: Authorization granted {{(pid=81650) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:40:07.799728 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88943591a13b49d7a62984131861ffca', 'request_id': 'req-bd8294d7-97e7-4065-9aba-6983af086d4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.806657 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88943591a13b49d7a62984131861ffca', 'request_id': 'req-bd8294d7-97e7-4065-9aba-6983af086d4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.813713 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88943591a13b49d7a62984131861ffca', 'request_id': 'req-bd8294d7-97e7-4065-9aba-6983af086d4c'} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.825407 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] The token cache is being invalidate because project 88943591a13b49d7a62984131861ffca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81650) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:40:07.825707 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.826435 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG keystone.notifications [None req-bd8294d7-97e7-4065-9aba-6983af086d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81650) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:40:07.828056 dv-cinder-854262-2-smb devstack@keystone.service[81650]: [pid: 81650|app: 0|req: 1478/2963] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Aug 29 20:40:07 2022] DELETE /identity/v3/projects/88943591a13b49d7a62984131861ffca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:40:17.441602 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:40:17.822309 dv-cinder-854262-2-smb devstack@keystone.service[81650]: DEBUG dbcounter [-] [81650] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:41:26.617125 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] Authenticating user token {{(pid=81651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:41:26.618803 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:26.729856 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7846-656d-49f1-9f10-195b87fc0138 service neutron] Validating token access rules against request {{(pid=81651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:41:26.796946 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f06b3389210c46d787994abe138ce87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '941aa49cf2084b51811308b74ee0411e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:41:26.797584 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] REQUEST_METHOD: `GET` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:41:26.797843 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] SCRIPT_NAME: `/identity` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:41:26.798135 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:41:26.800934 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.fernet_utils [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:41:26.815609 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:41:26.817277 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c3570-6be3-4917-bf6a-95c0f43aa55c service placement] RBAC: Authorization granted {{(pid=81651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:41:26.828842 dv-cinder-854262-2-smb devstack@keystone.service[81651]: [pid: 81651|app: 0|req: 1486/2964] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Aug 29 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:41:36.823556 dv-cinder-854262-2-smb devstack@keystone.service[81651]: DEBUG dbcounter [-] [81651] Writing DB stats keystone:SELECT=67 {{(pid=81651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}